-- Logs begin at Tue 2022-08-30 03:38:06 UTC, end at Tue 2022-08-30 04:44:24 UTC. -- Aug 30 04:19:40.129424 dv-cinder-854265-2-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 04:19:40.143288 dv-cinder-854265-2-smb devstack@n-api.service[105608]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:19:40 2022] *** Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: nodename: dv-cinder-854265-2-smb Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: machine: x86_64 Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: clock source: unix Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: pcre jit disabled Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: detected number of CPU cores: 4 Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: current working directory: / Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: your processes number limit is 47680 Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: your memory page size is 4096 bytes Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: detected max file descriptor number: 2048 Aug 30 04:19:40.145847 dv-cinder-854265-2-smb devstack@n-api.service[105608]: lock engine: pthread robust mutexes Aug 30 04:19:40.147430 dv-cinder-854265-2-smb devstack@n-api.service[105608]: thunder lock: enabled Aug 30 04:19:40.147430 dv-cinder-854265-2-smb devstack@n-api.service[105608]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 04:19:40.147430 dv-cinder-854265-2-smb devstack@n-api.service[105608]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:19:40.190700 dv-cinder-854265-2-smb devstack@n-api.service[105608]: Python main interpreter initialized at 0x55c0d7f7c9c0 Aug 30 04:19:40.190700 dv-cinder-854265-2-smb devstack@n-api.service[105608]: python threads support enabled Aug 30 04:19:40.190700 dv-cinder-854265-2-smb devstack@n-api.service[105608]: your server socket listen backlog is limited to 100 connections Aug 30 04:19:40.190700 dv-cinder-854265-2-smb devstack@n-api.service[105608]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:19:40.191335 dv-cinder-854265-2-smb devstack@n-api.service[105608]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:19:40.191335 dv-cinder-854265-2-smb devstack@n-api.service[105608]: *** Operational MODE: preforking *** Aug 30 04:19:40.191527 dv-cinder-854265-2-smb devstack@n-api.service[105608]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:19:40.191527 dv-cinder-854265-2-smb devstack@n-api.service[105608]: spawned uWSGI master process (pid: 105608) Aug 30 04:19:40.191785 dv-cinder-854265-2-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 30 04:19:40.193248 dv-cinder-854265-2-smb devstack@n-api.service[105608]: spawned uWSGI worker 1 (pid: 105609, cores: 1) Aug 30 04:19:40.193248 dv-cinder-854265-2-smb devstack@n-api.service[105608]: spawned uWSGI worker 2 (pid: 105610, cores: 1) Aug 30 04:19:40.193248 dv-cinder-854265-2-smb devstack@n-api.service[105608]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:19:40.941299 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:19:40.966428 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:19:42.104903 dv-cinder-854265-2-smb devstack@n-api.service[105609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:19:42.104903 dv-cinder-854265-2-smb devstack@n-api.service[105609]: from cryptography.utils import int_from_bytes Aug 30 04:19:42.106003 dv-cinder-854265-2-smb devstack@n-api.service[105609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:19:42.106003 dv-cinder-854265-2-smb devstack@n-api.service[105609]: from cryptography.utils import int_from_bytes Aug 30 04:19:42.166877 dv-cinder-854265-2-smb devstack@n-api.service[105610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:19:42.166877 dv-cinder-854265-2-smb devstack@n-api.service[105610]: from cryptography.utils import int_from_bytes Aug 30 04:19:42.167823 dv-cinder-854265-2-smb devstack@n-api.service[105610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:19:42.167823 dv-cinder-854265-2-smb devstack@n-api.service[105610]: from cryptography.utils import int_from_bytes Aug 30 04:19:44.824708 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:19:44.825798 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:19:44.825798 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:19:44.826053 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:19:44.826299 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:19:44.826692 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.827018 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.827344 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.827659 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.828025 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.828335 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.828656 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.828975 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.829302 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.829563 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.829877 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.830200 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-smb {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.830519 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.830824 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.831131 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.831448 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.831749 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.832093 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.832400 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.832902 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.833478 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.833693 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.833949 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.834289 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.834876 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.835175 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.835487 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.835792 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.836127 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.836438 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.836809 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-smb {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.837080 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.837390 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.837751 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.838076 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.838337 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.838647 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.838961 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.839263 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.839582 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.839898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.840229 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.840515 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.840790 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.841194 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.841512 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.841824 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.842145 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.842454 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.842759 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.843010 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.843318 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.843646 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.843998 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.844326 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.844576 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.844827 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.845150 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.845471 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.845777 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.846059 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.846371 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.846672 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.847092 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.847332 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.847695 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.847942 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.848181 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.848593 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.848788 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.849105 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.849427 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.849838 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.850088 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.850395 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.850739 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.851058 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.851364 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.851682 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.852033 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.852340 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.852646 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.852951 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.853269 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.853601 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.853904 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.854227 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.854422 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.854728 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.855045 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.855348 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.855650 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.855978 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.856406 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.856810 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.857119 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.857431 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.857734 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.858040 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.858347 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.858767 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.858978 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.859239 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.859562 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.859885 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.860225 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.860526 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.860831 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.861134 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.861454 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.861759 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.862065 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.862381 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.862687 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.862993 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.863330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.863615 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.863973 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.864257 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.864561 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.864862 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.865222 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.865544 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.865839 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.866135 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.866437 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.866736 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.867042 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.867349 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.867646 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.867973 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.868296 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.868614 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.868973 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.869225 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.869531 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.869851 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.870192 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.870519 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.870866 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.871179 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.871511 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.871884 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.872438 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.872758 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.873074 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.873403 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.873714 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.874022 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.874334 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.874648 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.874967 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.875299 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.875609 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.875953 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.876263 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.876570 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.876887 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.877223 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.877542 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.877854 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.878193 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.878540 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.878854 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.879222 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.879562 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.879947 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.880261 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.880569 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.880888 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.881224 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.881536 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.881849 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.882158 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.882483 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.882792 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.883101 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.883406 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.883714 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.884045 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.884386 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.884703 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.885023 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.885336 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.885745 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.886071 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.886383 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.886690 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.886992 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.887304 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.887726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.888109 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.888424 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.888798 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.889388 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.889605 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.889869 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.890209 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.890515 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.890823 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.891133 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.891446 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.891754 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.892093 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.892406 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.892709 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.893037 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.893344 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.893717 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.894051 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.894294 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.894571 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.894889 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.895199 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.895538 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.895807 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.896144 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.896474 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.896821 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.897101 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.897433 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.897766 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.898086 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.898381 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.898708 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.899024 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.899329 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.899637 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.899964 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.900272 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.900574 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.900877 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.901180 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.901486 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.901783 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.902087 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.902423 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.902752 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.903026 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.903572 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.903898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.904227 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.904581 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.904881 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.905230 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.905569 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.905886 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.906204 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.906511 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.906830 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.907137 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.907453 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.907763 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.908100 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.908416 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.908728 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.909042 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.909353 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.909683 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.910008 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.910332 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.910608 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.910929 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.911264 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.911598 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.912100 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.912325 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.912539 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.912846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.913148 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.913457 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.913765 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.914072 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.914388 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.914690 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.915022 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.915306 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.915631 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.915959 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.916272 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.916578 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.916890 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.917215 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.917598 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.917857 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.918165 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.918513 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.918940 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.919388 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.919660 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.919993 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.920344 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.920603 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.920948 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.921549 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.921848 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.922152 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.922463 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.922799 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.923076 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.923408 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.923667 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.924029 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.924336 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.924639 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.924963 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.925266 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.925567 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.925881 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.926189 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.926534 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.926875 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.927121 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.927427 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.927741 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.928085 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.928385 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.928704 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.929054 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.929375 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.929766 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.929949 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.930243 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.930626 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.930829 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.931151 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.931456 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.931777 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.932113 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.932440 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.932746 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.933276 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.933276 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.933797 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.933985 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.934237 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.935054 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.935389 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.935892 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.936239 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.936560 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.936943 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.937231 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.937567 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.937880 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.938186 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.938492 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.938799 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.939103 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.941124 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.941124 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.941124 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.941124 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.941124 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.941124 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.942318 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.942318 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.942318 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.942318 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.943466 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.943466 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.943466 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.943466 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.944314 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.944314 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.944314 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.944911 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.944911 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.945309 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.945505 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.945739 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.946069 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.946378 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.946684 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.947008 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.947312 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.947622 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.947957 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.948261 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.948567 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.948868 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.949179 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.949486 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.949792 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.950179 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.950482 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.950987 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.951377 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.951582 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.951890 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.952228 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.952532 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.952842 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.953154 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.953436 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.953739 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.954046 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.954374 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.954676 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.954971 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.955278 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.955582 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.955888 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.956217 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.956549 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.956858 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.957158 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.957465 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.957770 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.958078 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.958378 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.959001 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.959001 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.959489 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.959796 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.960135 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.960435 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.960741 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.961045 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.961353 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.961653 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.961957 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.962257 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.962557 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.962869 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.963180 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.963485 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.963787 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.964117 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.964416 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.964761 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.965061 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.965423 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.965856 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.966174 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.966494 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.966811 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.967204 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.967610 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.967988 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.968313 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.968626 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.968940 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.969246 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.969551 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.969878 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.970199 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.970501 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.970823 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.971139 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.971467 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.971768 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.972102 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.972418 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.972718 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.973030 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.973337 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.973639 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.973950 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.974254 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.974565 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.974870 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.975171 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.975478 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.975781 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.976112 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.976439 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.976748 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.977051 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.977360 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.977666 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.977977 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.978277 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.978722 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.979052 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.979348 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.979656 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.979989 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.980304 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.980620 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.980933 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.981339 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.981736 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.982048 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.982357 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.982668 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.982974 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.983279 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.983591 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.984049 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.984251 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.984538 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.984840 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.985163 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.985466 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.985784 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.986211 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.986522 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.986828 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.987242 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.987561 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.987873 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.988224 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.988546 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.988754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:19:44.989460 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.989646 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:19:44.989835 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.989835 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.990230 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:19:44.990418 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.990599 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:19:44.990779 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.990974 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:19:44.991179 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.991363 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.991563 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.991734 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.991945 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.992131 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.992343 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.992532 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.992708 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.992889 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.993069 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.993269 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.993444 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.993646 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.993821 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.994015 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.994212 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.994399 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.994601 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.994802 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.994993 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.995175 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.995412 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.995602 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-smb {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.995788 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.996017 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.996215 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.996418 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.996635 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.996823 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.997036 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.997258 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.997448 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.997647 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.997813 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.997986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.998172 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.998371 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.998562 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.998774 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.998992 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.999200 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.999391 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:44.999582 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:44.999765 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.000005 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.000198 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.000198 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.000535 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.000709 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.000901 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.001133 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.001433 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.001618 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.001799 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.001989 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.002191 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.002390 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.002581 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.002754 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.002965 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.003278 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.003459 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-smb {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.003633 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.003822 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.004013 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.004207 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.004363 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.004363 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.004679 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.004880 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.005072 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.005278 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.005479 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.005687 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.005858 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.006059 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.006246 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.006430 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.006601 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.006783 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.006969 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.007180 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.007396 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.007569 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.007782 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.007992 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.008170 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.008354 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.008558 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.008744 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.008947 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.009139 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.009317 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.009503 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.009689 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.009883 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.010082 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.010262 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.010418 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.010621 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.010794 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.010794 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.011168 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.011359 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.011560 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.011560 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.011958 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.012154 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.012329 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.013000 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.013192 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.013422 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.013600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.013785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.013964 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.014158 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.014378 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.014550 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.014733 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.014905 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.015099 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.015297 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.015511 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.015708 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.015891 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.016107 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.016307 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.016486 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.016697 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.016907 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.017104 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.017291 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.017484 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.017679 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.017881 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.018054 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.018225 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.018391 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.018614 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.018812 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.018978 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.019164 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.019614 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.019823 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.019823 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.020366 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.020557 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.020557 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.020933 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.020933 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.021303 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.021488 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.021663 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.021663 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.022007 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.022209 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.022421 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.022421 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.022764 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.023064 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.023300 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.023496 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.023682 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.023883 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.024105 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.024326 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.024518 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.024700 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.024904 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.025106 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.025306 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.025502 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.025866 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.026068 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.026296 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.026507 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.026703 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.026906 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.027082 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.027281 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.027469 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.027669 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.028132 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.028362 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.028557 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.028949 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.029143 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.029343 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.029514 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.029706 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.029903 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.030117 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.030318 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.030637 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.030832 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.031018 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.031224 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.031403 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.031590 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.031756 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.031977 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.032150 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.032370 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.032541 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.032723 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.032912 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.033105 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.033292 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.033499 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.033677 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.033859 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.034048 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.034235 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.034450 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.034639 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.034836 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.035022 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.035215 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.035423 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.035610 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.035826 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.036053 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.036244 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.036441 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.036650 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.036862 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.037035 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.037219 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.037409 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.037596 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.037786 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.038010 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.038205 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.038395 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.038581 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.038745 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.038745 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.039196 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.039398 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.039584 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.039755 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.040089 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.040089 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.040483 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.040676 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.040864 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.041055 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.041249 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.041462 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.041664 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.041836 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.042004 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.042207 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.042395 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.042577 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.042772 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.042946 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.043137 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.043322 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.043493 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.043849 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.044070 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.044276 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.044478 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.044648 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.044862 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.045065 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.045242 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.045427 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.045613 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.045802 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.046359 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.046359 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.046714 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.046914 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:19:45.047111 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.047299 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.047509 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.047698 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.047964 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.048162 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.048349 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.048565 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.048767 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.048947 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.049128 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.049128 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.049493 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.049685 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.049888 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.050121 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.050351 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.050559 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.050733 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.050964 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.051170 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.051357 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.051546 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.051760 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.051979 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.052201 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.052404 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.052580 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.052761 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.052955 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.053223 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.053443 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.053646 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.053863 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.054038 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.054225 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.054481 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.054667 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.054871 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.055063 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.055300 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.055492 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.055676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.055931 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.056121 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.056314 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.056484 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.056675 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.056865 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.057108 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.057289 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.057522 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.057718 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.057906 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.058122 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.058312 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.058498 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.058689 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.058860 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.059072 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.059251 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.059783 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.059783 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.059783 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.061542 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.061772 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.061982 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.062191 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.062447 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.062671 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.062898 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.063109 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.063317 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.063533 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.063739 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.064043 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.064249 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.064489 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.064694 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.064897 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.065111 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.065305 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.065523 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.065731 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.065932 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.066135 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.066337 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.066539 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.066764 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.066966 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.067180 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.067382 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.067590 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.067590 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.068029 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.068232 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.068433 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.068649 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.068848 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.069049 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.069286 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.069491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.069693 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.069900 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.070117 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.070330 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.070530 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.070736 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.070936 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.071136 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.071335 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.071546 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.071747 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.072052 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.072253 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.072449 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.072669 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.072883 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.073093 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.073286 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.073483 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.073691 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.073890 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.074102 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.074305 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.074504 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.074698 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.075032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.075251 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.075445 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.075625 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.075625 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.076003 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.076003 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.076391 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.076596 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.076796 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.076994 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.077197 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.077408 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.077620 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.077831 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.078030 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.078228 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.078425 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.078749 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.078958 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.079166 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.079366 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.079562 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.079754 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.079996 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.080189 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.080391 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.080587 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.080587 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.080968 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.081178 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.081178 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.081558 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.081558 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.081954 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.082152 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.082152 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.082549 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.082738 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.082738 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.083111 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.083323 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.083524 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.083724 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.083724 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.084118 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.084317 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.084317 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.084719 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.084918 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.084918 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.085300 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.085498 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.085498 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.085895 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.086093 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.086289 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.086498 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.086498 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.086894 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.087096 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.087096 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.087490 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.087704 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.087704 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.088122 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.088321 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.088321 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.088689 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.088890 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.088890 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.089283 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.089481 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.089481 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.089844 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.090080 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.090080 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.090469 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.090834 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.091034 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.091233 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.091233 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.091642 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.091840 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.091840 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.092254 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.092509 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.092509 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.092896 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.093097 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.093097 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.093479 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.093772 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.094045 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.094292 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.094292 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.094715 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.094926 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.094926 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.095310 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.095555 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.095555 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.095996 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.096202 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.096470 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.096470 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.096881 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.097099 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.097301 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.097539 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.097740 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.097740 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.098112 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.098328 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.098328 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.098859 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.099080 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.099080 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.099486 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.099682 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.099889 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.100113 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.100113 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.100477 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.100700 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.100700 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.101070 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.101270 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.101270 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.101641 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.101852 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.102085 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.102284 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.102284 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.102722 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.102942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.102942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.103379 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.103579 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.103579 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.104002 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.104221 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.104221 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.104599 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.104799 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.104799 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.105171 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.105385 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.105586 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.105841 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.105841 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.106341 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.106555 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.106555 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.106988 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.107188 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.107188 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.107633 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.108075 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.108075 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.108476 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.108686 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.108686 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.109056 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.109270 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.109270 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.109647 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.109846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.109846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.110211 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.110446 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.110446 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.110817 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.111038 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.111038 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.111428 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.111632 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.111632 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.112083 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.112274 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.112467 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.112659 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.112868 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.113065 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.113290 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.113484 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.113692 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.113885 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.113885 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.114275 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.114488 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.114488 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.114870 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.115098 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.115098 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.115458 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.115648 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.115648 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.116199 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.116416 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.116631 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.116819 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.116819 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.117160 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.117333 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.117333 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.117701 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.117931 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.117931 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.118317 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.118536 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.118536 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.118936 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.119218 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.119218 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.119629 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.119862 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.119862 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.120278 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.120490 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.120490 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.120881 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.121118 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.121321 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.121604 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.122500 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.122772 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.122772 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.123190 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.123386 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.123386 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.123771 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.124016 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.124253 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.124563 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.124563 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.125011 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.125230 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.125230 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.125596 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.125840 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.125840 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.126257 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.126464 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.126464 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.126896 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.127140 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.127140 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.127508 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.127704 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.127704 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.128166 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.128442 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.128442 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.128831 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.129028 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.129028 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.129418 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.129617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.129814 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.130018 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.130213 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.130408 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.130408 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.130788 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.130988 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.130988 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.131372 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.131577 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.131577 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.131993 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.132209 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.132209 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.132581 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.132781 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133001 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133199 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133199 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133562 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.133741 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.135171 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.136661 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.138750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.140216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.141600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.143020 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.144554 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.146027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.147676 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.149285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.150846 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.152365 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.154434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.155986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.157491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.158997 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.160617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.162146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.163707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.165161 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.165161 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.165161 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.165161 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.165161 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.165161 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.165161 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.166423 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.166423 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.166423 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.166423 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.167176 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.167176 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.167176 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.167735 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.167735 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.168192 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.168386 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.168722 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.169167 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.170115 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.170478 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.170844 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.171631 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.171892 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.172251 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.172580 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.172919 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.173240 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.173583 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.173956 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.174281 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.174613 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.174937 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.175240 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.175542 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.175867 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.176278 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.176508 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.176819 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.177139 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.177423 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.177729 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.178073 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.178376 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.178707 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.179014 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.179336 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.179649 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.179988 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.180303 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.180617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.180930 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.181249 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.181561 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.181866 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.182183 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.182496 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.182811 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.183386 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.183715 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.184059 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.184517 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.185575 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.185933 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.186276 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.186614 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.186927 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.187239 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.187550 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.187884 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.188355 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.188693 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.189058 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.189405 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.189726 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.190079 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.190419 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.190785 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.191121 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.191456 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.191803 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.192152 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.192491 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.192802 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.193111 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.193446 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.193778 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.194111 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.194490 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.194745 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.195079 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.195445 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.195759 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.196129 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.196446 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.196795 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.197115 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.197703 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.198012 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.198344 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.198667 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.198988 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.199307 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.199627 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.200089 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.200341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.201328 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.201645 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.201957 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.202269 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.202594 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.202904 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.203210 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.203529 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.203839 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.204461 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.204812 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.205132 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.205458 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.205782 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.206097 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.206405 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.206729 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.207035 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.207339 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.207655 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.207992 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.208301 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.208606 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.208918 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.209224 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.209527 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.209836 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.210140 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.210470 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.210775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.211079 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.211381 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.211694 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.212030 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.212333 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.212639 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.212940 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.213253 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.213555 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.213862 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.214163 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.214473 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.214775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.215081 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.215441 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.215805 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.216938 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.217266 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.217597 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.217942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.218270 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.218608 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.218947 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.219324 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.219646 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.220327 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.220668 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.221140 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.221513 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.221874 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.222192 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.222539 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.222849 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.223179 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.223514 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.223827 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.224172 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.224487 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.224798 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.225107 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.225416 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.225724 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.226032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.226338 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.226645 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.227036 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.227323 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.227606 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.228035 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.228366 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.228710 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.229028 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.229344 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.229664 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.229972 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.230281 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.230587 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.230896 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.231627 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.232108 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.232561 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.232899 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.233388 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.233709 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.234034 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.234363 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.234677 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.235006 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.235330 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.235669 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.236043 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.236377 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.236895 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.237270 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.237605 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.237934 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.238243 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.238549 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.238856 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.239169 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.239494 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.239806 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.240146 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.240451 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.240761 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.241067 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.241375 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.241679 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.241989 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.242300 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.242604 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.242906 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.243209 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.243619 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.243812 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.244134 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.244444 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.244750 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.245057 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.245360 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.245667 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.245972 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.246312 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.246645 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.247104 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.248151 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.248479 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.248811 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.249125 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.249451 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.249774 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.250098 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.250408 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.250747 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.251059 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.251374 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.251690 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.252036 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.252354 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.252665 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.253005 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.253332 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.253793 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.254003 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.254272 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.254599 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.254915 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.255225 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.255556 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.255865 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.256209 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.256519 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.256832 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.257142 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.257517 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.257772 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.258084 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.258401 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.258717 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.259050 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.259374 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.259684 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.260052 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.260380 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.260740 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.261054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.261524 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.261862 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.262183 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.262584 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.263142 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:19:45.264166 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:19:45.329987 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO dbcounter [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Registered counter for database nova_api Aug 30 04:19:45.356858 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_db.sqlalchemy.engines [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.364892 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writer thread running {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:45.427596 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.context [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f61739b9-662a-4f7a-9573-4e7676b7b5de(cell1) {{(pid=105609) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:19:45.431576 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_concurrency.lockutils [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.432094 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_concurrency.lockutils [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.432833 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO dbcounter [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Registered counter for database nova_api Aug 30 04:19:45.433752 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_concurrency.lockutils [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.434744 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_concurrency.lockutils [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.435340 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_concurrency.lockutils [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.437513 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_concurrency.lockutils [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.439648 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO dbcounter [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Registered counter for database nova_cell0 Aug 30 04:19:45.445967 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO dbcounter [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Registered counter for database nova_cell1 Aug 30 04:19:45.454874 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_db.sqlalchemy.engines [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.456555 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_db.sqlalchemy.engines [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.460394 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_db.sqlalchemy.engines [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.463787 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writer thread running {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:45.468306 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writer thread running {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:45.472821 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writer thread running {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:45.528175 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.context [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f61739b9-662a-4f7a-9573-4e7676b7b5de(cell1) {{(pid=105610) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:19:45.534042 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.534540 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.536188 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.537033 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.537520 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.539594 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.541753 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO dbcounter [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Registered counter for database nova_cell0 Aug 30 04:19:45.547203 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO dbcounter [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Registered counter for database nova_cell1 Aug 30 04:19:45.556216 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_db.sqlalchemy.engines [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.562416 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_db.sqlalchemy.engines [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.565792 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writer thread running {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:45.721000 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writer thread running {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:45.732739 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO dbcounter [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Registered counter for database nova_cell0 Aug 30 04:19:45.742297 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_db.sqlalchemy.engines [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.750447 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writer thread running {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:45.750907 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO dbcounter [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Registered counter for database nova_cell0 Aug 30 04:19:45.764684 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG oslo_db.sqlalchemy.engines [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:19:45.772202 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writer thread running {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:19:46.124880 dv-cinder-854265-2-smb devstack@n-api.service[105610]: WARNING keystonemiddleware.auth_token [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:19:46.132785 dv-cinder-854265-2-smb devstack@n-api.service[105610]: WARNING keystonemiddleware.auth_token [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:19:46.243687 dv-cinder-854265-2-smb devstack@n-api.service[105609]: WARNING keystonemiddleware.auth_token [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:19:46.252444 dv-cinder-854265-2-smb devstack@n-api.service[105609]: WARNING keystonemiddleware.auth_token [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:19:46.500851 dv-cinder-854265-2-smb devstack@n-api.service[105610]: WARNING keystonemiddleware.auth_token [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:19:46.508210 dv-cinder-854265-2-smb devstack@n-api.service[105610]: WARNING keystonemiddleware.auth_token [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:19:46.514654 dv-cinder-854265-2-smb devstack@n-api.service[105610]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c0d7f7c9c0 pid: 105610 (default app) Aug 30 04:19:46.517136 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.518460 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] 10.222.0.91 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002095 Aug 30 04:19:46.518900 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 788 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:46.628725 dv-cinder-854265-2-smb devstack@n-api.service[105609]: WARNING keystonemiddleware.auth_token [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:19:46.635116 dv-cinder-854265-2-smb devstack@n-api.service[105609]: WARNING keystonemiddleware.auth_token [None req-0aade848-3a29-41df-b1f1-e1d628de28be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:19:46.641765 dv-cinder-854265-2-smb devstack@n-api.service[105609]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c0d7f7c9c0 pid: 105609 (default app) Aug 30 04:21:26.345725 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.348705 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003372 Aug 30 04:21:26.359009 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 2/2] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:26.374844 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writing DB stats nova_api:SELECT=3 {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:26.376276 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writing DB stats nova_cell0:SELECT=3 {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:26.377959 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writing DB stats nova_cell1:SELECT=3 {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:26.379953 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:27.804079 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-2154d5f7-e7fb-4e64-9433-6bee561b9c7c admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:27.842515 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-2154d5f7-e7fb-4e64-9433-6bee561b9c7c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.481508 Aug 30 04:21:27.843984 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 1/3] 10.222.0.91 () {60 vars in 1292 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:30.828030 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.829062 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-14467b0e-d76f-47e2-b855-1b6ffcee5888 None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 30 04:21:30.829759 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 3/4] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:31.379892 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-c276f559-527b-4bbf-aa0b-596f8414ebe4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "id": "c1", "ram": 256, "disk": 1}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:31.431977 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-c276f559-527b-4bbf-aa0b-596f8414ebe4 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.595002 Aug 30 04:21:31.432922 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 2/5] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:21:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:21:31.668463 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-f6193468-d571-4c3c-a71d-76dce52568a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:31.675816 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_api:SELECT=3 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:31.676907 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_cell0:SELECT=3 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:31.678514 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_cell1:SELECT=3 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:31.679525 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:31.781990 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-f6193468-d571-4c3c-a71d-76dce52568a2 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.340150 Aug 30 04:21:31.783991 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 4/6] 10.222.0.91 () {64 vars in 1336 bytes} [Tue Aug 30 04:21:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:34.614395 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-c276f559-527b-4bbf-aa0b-596f8414ebe4 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.616405 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-c276f559-527b-4bbf-aa0b-596f8414ebe4 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002621 Aug 30 04:21:34.617337 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 3/7] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:35.364362 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-60f85a31-1c0b-46a5-ae37-41753a1da490 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "swap": 0}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:35.434600 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-60f85a31-1c0b-46a5-ae37-41753a1da490 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.809546 Aug 30 04:21:35.435934 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 5/8] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:21:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:21:35.453232 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-98882cc7-56ce-4513-8e44-d2618d2318ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:35.504165 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-98882cc7-56ce-4513-8e44-d2618d2318ca admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054615 Aug 30 04:21:35.504946 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 4/9] 10.222.0.91 () {64 vars in 1336 bytes} [Tue Aug 30 04:21:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:38.720236 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-60f85a31-1c0b-46a5-ae37-41753a1da490 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.721695 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-60f85a31-1c0b-46a5-ae37-41753a1da490 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Aug 30 04:21:38.722335 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 6/10] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:39.347165 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-cc64710d-4424-4c9a-9dee-8e5617b1962f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "ram": 1024, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:39.374537 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-cc64710d-4424-4c9a-9dee-8e5617b1962f admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.644319 Aug 30 04:21:39.375986 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 5/11] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:21:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:21:39.394743 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-93187ae8-e27e-412c-8f63-7c0e4ca28672 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:39.430789 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-93187ae8-e27e-412c-8f63-7c0e4ca28672 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041609 Aug 30 04:21:39.432427 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 7/12] 10.222.0.91 () {64 vars in 1336 bytes} [Tue Aug 30 04:21:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:42.212420 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-cc64710d-4424-4c9a-9dee-8e5617b1962f admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.213645 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-cc64710d-4424-4c9a-9dee-8e5617b1962f admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Aug 30 04:21:42.214060 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 6/13] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:42.980072 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-95f799e3-6421-4876-8208-56b7f1c59a26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3"}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:43.017863 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-95f799e3-6421-4876-8208-56b7f1c59a26 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.796597 Aug 30 04:21:43.018421 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 8/14] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:21:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:21:43.040080 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-08c0fe77-921a-425d-acfe-b6bc58f68e36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:43.082614 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-08c0fe77-921a-425d-acfe-b6bc58f68e36 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049668 Aug 30 04:21:43.083607 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 7/15] 10.222.0.91 () {64 vars in 1336 bytes} [Tue Aug 30 04:21:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:46.288900 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-95f799e3-6421-4876-8208-56b7f1c59a26 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.293204 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-95f799e3-6421-4876-8208-56b7f1c59a26 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004962 Aug 30 04:21:46.295433 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 9/16] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:46.990174 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-7ad86934-a3d9-45df-a1cf-cf3da265aae0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "name": "ds4G", "swap": 0}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:47.025159 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-7ad86934-a3d9-45df-a1cf-cf3da265aae0 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.722526 Aug 30 04:21:47.027961 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 8/17] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:21:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:21:47.043373 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-f2e7b373-98f6-4c72-a898-3d87ef25e5b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:47.083039 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-f2e7b373-98f6-4c72-a898-3d87ef25e5b8 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046877 Aug 30 04:21:47.084333 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 10/18] 10.222.0.91 () {64 vars in 1336 bytes} [Tue Aug 30 04:21:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:49.862451 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-7ad86934-a3d9-45df-a1cf-cf3da265aae0 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:49.864623 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-7ad86934-a3d9-45df-a1cf-cf3da265aae0 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004133 Aug 30 04:21:49.865137 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 9/19] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:50.513978 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-5b69518b-9d10-4a04-9dea-ae5b89df197b admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.547434 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-5b69518b-9d10-4a04-9dea-ae5b89df197b admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.672175 Aug 30 04:21:50.548326 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 11/20] 10.222.0.91 () {60 vars in 1292 bytes} [Tue Aug 30 04:21:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:53.532177 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-7ad86934-a3d9-45df-a1cf-cf3da265aae0 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.534064 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-7ad86934-a3d9-45df-a1cf-cf3da265aae0 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002813 Aug 30 04:21:53.534818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 10/21] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:54.127412 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-31f7973d-2a42-4000-a579-d9554beeb078 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "id": "1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:54.160570 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-31f7973d-2a42-4000-a579-d9554beeb078 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.617338 Aug 30 04:21:54.161588 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 12/22] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:21:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:21:54.179864 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-7fbe7eff-c90e-4723-8268-3319c10d93ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:54.220145 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-7fbe7eff-c90e-4723-8268-3319c10d93ff admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044804 Aug 30 04:21:54.220645 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 11/23] 10.222.0.91 () {64 vars in 1333 bytes} [Tue Aug 30 04:21:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:56.881991 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-31f7973d-2a42-4000-a579-d9554beeb078 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:56.883159 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-31f7973d-2a42-4000-a579-d9554beeb078 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 30 04:21:56.884450 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 13/24] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:57.395237 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-7d36bce5-6789-460e-8f51-7782ee97e85b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:57.402930 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:57.421657 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-7d36bce5-6789-460e-8f51-7782ee97e85b admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529293 Aug 30 04:21:57.422262 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 12/25] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:21:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:21:57.442125 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-928f8a1b-33a8-4d80-a5fc-43ce35e3c222 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:57.478355 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-928f8a1b-33a8-4d80-a5fc-43ce35e3c222 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041015 Aug 30 04:21:57.479568 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 14/26] 10.222.0.91 () {64 vars in 1333 bytes} [Tue Aug 30 04:21:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:00.286172 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-7d36bce5-6789-460e-8f51-7782ee97e85b admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:00.287969 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-7d36bce5-6789-460e-8f51-7782ee97e85b admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002308 Aug 30 04:22:00.306662 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 13/27] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:22:01.132591 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-a42c71be-5c76-4a3f-92bf-0ca0488c5989 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:01.161446 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-a42c71be-5c76-4a3f-92bf-0ca0488c5989 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.865230 Aug 30 04:22:01.177391 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-b6dcc510-9143-47dd-b940-63014df8dac5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:01.183762 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 15/28] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:22:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:01.209324 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-b6dcc510-9143-47dd-b940-63014df8dac5 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036215 Aug 30 04:22:01.224396 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 14/29] 10.222.0.91 () {64 vars in 1333 bytes} [Tue Aug 30 04:22:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:03.956765 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-a42c71be-5c76-4a3f-92bf-0ca0488c5989 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:03.957863 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-a42c71be-5c76-4a3f-92bf-0ca0488c5989 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 30 04:22:03.959185 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 16/30] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:04.678852 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-adfc6ada-6e83-4ffd-8634-f44f4f97b11a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "vcpus": 4}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:04.713301 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-adfc6ada-6e83-4ffd-8634-f44f4f97b11a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.746657 Aug 30 04:22:04.714099 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 15/31] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:22:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:04.734986 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-1de56362-f338-4125-ba4e-e824f72d860e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:04.749673 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:04.793002 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-1de56362-f338-4125-ba4e-e824f72d860e admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062384 Aug 30 04:22:04.793880 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 17/32] 10.222.0.91 () {64 vars in 1333 bytes} [Tue Aug 30 04:22:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:07.870914 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-adfc6ada-6e83-4ffd-8634-f44f4f97b11a admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:07.873150 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-adfc6ada-6e83-4ffd-8634-f44f4f97b11a admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002962 Aug 30 04:22:07.874268 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 16/33] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:08.550061 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-76b08b4b-73b8-400d-b746-3b5ecadf5c4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:08.589357 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-76b08b4b-73b8-400d-b746-3b5ecadf5c4a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.704149 Aug 30 04:22:08.602343 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 18/34] 10.222.0.91 () {64 vars in 1283 bytes} [Tue Aug 30 04:22:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:08.613635 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-820004c9-0abd-490f-88c2-6f1181ae4220 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:08.681318 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-820004c9-0abd-490f-88c2-6f1181ae4220 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074832 Aug 30 04:22:08.696032 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 17/35] 10.222.0.91 () {64 vars in 1333 bytes} [Tue Aug 30 04:22:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:25.985702 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-76b08b4b-73b8-400d-b746-3b5ecadf5c4a admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:25.986951 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-76b08b4b-73b8-400d-b746-3b5ecadf5c4a admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001813 Aug 30 04:22:25.987437 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 19/36] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:22:26.000095 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:26.513664 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-89122ac4-2af6-4c64-bf2f-54d31c17d197 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:26.535016 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-89122ac4-2af6-4c64-bf2f-54d31c17d197 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.539898 Aug 30 04:22:26.535781 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 18/37] 10.222.0.91 () {60 vars in 1292 bytes} [Tue Aug 30 04:22:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:27.770530 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-76b08b4b-73b8-400d-b746-3b5ecadf5c4a admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:27.771582 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-76b08b4b-73b8-400d-b746-3b5ecadf5c4a admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 30 04:22:27.772040 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 20/38] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:28.481917 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-2dfd690c-dc89-4b6f-8f88-349f344a77ab admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.488516 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.wsgi [None req-2dfd690c-dc89-4b6f-8f88-349f344a77ab admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-2dfd690c-dc89-4b6f-8f88-349f344a77ab admin admin] Request method failure captured: Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Accept: application/json Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Accept-Encoding: gzip, deflate Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Connection: keep-alive Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Content-Length: 0 Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Host: 10.222.0.91 Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Openstack-Api-Version: compute 2.90 Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Openstack-System-Scope: None Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: User-Agent: python-novaclient Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Auth-Token: gAAAAABjDZCDptQ3v1HpastyKICVCTcsIMd_eErVsFBCl8ah_JvpvQGGlaVgHcqgBMXDp0FQr8bzX8IAjMwzHOlnSMLTjqSTfJuPsh-2ugXeRBH7EIsOGf0l66fiDQ5EaBM_0XZdFFq2jJn8uHWfGn8fBbu4Lwby34S0vZfKNcKcUkggJhI2kkk Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Domain-Id: None Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Domain-Name: None Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Identity-Status: Confirmed Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Is-Admin-Project: True Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Domain-Id: default Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Domain-Name: Default Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Name: admin Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Role: admin,member,reader Aug 30 04:22:28.492044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Roles: admin,member,reader Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant: admin Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant-Name: admin Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User: admin Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Domain-Id: default Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Domain-Name: Default Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Id: 7a4a4a4d468841a8acfbd6ef778ab3bd Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Name: admin Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: method: > Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: exception: Flavor 42 could not be found. Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: action_args: {'id': '42'} Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:28.494846 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.496755 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.499288 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-2dfd690c-dc89-4b6f-8f88-349f344a77ab admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:28.501749 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-2dfd690c-dc89-4b6f-8f88-349f344a77ab admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.580476 Aug 30 04:22:28.501749 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 19/39] 10.222.0.91 () {60 vars in 1190 bytes} [Tue Aug 30 04:22:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 582 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:28.507522 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-53ff592c-d88c-4963-90b2-40bf9bd1253c admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.512128 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:28.533938 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-53ff592c-d88c-4963-90b2-40bf9bd1253c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030484 Aug 30 04:22:28.534538 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 21/40] 10.222.0.91 () {60 vars in 1210 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:28.545539 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-5235d9d2-421e-432b-8237-a0079cdf09d8 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.573171 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-5235d9d2-421e-432b-8237-a0079cdf09d8 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031230 Aug 30 04:22:28.573770 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 20/41] 10.222.0.91 () {60 vars in 1210 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:28.591540 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-4c5f3474-0ab9-4198-ab04-eb1f4c240f73 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.604891 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.wsgi [None req-4c5f3474-0ab9-4198-ab04-eb1f4c240f73 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-4c5f3474-0ab9-4198-ab04-eb1f4c240f73 admin admin] Request method failure captured: Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Accept: application/json Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Accept-Encoding: gzip, deflate Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Connection: keep-alive Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Content-Length: 0 Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Host: 10.222.0.91 Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Openstack-Api-Version: compute 2.90 Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Openstack-System-Scope: None Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: User-Agent: python-novaclient Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Auth-Token: gAAAAABjDZCDptQ3v1HpastyKICVCTcsIMd_eErVsFBCl8ah_JvpvQGGlaVgHcqgBMXDp0FQr8bzX8IAjMwzHOlnSMLTjqSTfJuPsh-2ugXeRBH7EIsOGf0l66fiDQ5EaBM_0XZdFFq2jJn8uHWfGn8fBbu4Lwby34S0vZfKNcKcUkggJhI2kkk Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Domain-Id: None Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Domain-Name: None Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Identity-Status: Confirmed Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Is-Admin-Project: True Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Domain-Id: default Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Domain-Name: Default Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Name: admin Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Role: admin,member,reader Aug 30 04:22:28.611032 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Roles: admin,member,reader Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant: admin Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant-Name: admin Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User: admin Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Domain-Id: default Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Domain-Name: Default Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Id: 7a4a4a4d468841a8acfbd6ef778ab3bd Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Name: admin Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: method: > Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: exception: Flavor 42 could not be found. Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: action_args: {'id': '42'} Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:28.613671 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.614921 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.616027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-4c5f3474-0ab9-4198-ab04-eb1f4c240f73 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:28.618597 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-4c5f3474-0ab9-4198-ab04-eb1f4c240f73 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.029857 Aug 30 04:22:28.618597 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 22/42] 10.222.0.91 () {60 vars in 1190 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:29.713214 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-5235d9d2-421e-432b-8237-a0079cdf09d8 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:29.714241 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-5235d9d2-421e-432b-8237-a0079cdf09d8 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 30 04:22:29.714651 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 21/43] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:30.364471 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-2a1e9420-8e23-4bb8-9a67-1776d61ae11c admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.374543 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.wsgi [None req-2a1e9420-8e23-4bb8-9a67-1776d61ae11c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-2a1e9420-8e23-4bb8-9a67-1776d61ae11c admin admin] Request method failure captured: Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Accept: application/json Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Accept-Encoding: gzip, deflate Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Connection: keep-alive Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Content-Length: 0 Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Host: 10.222.0.91 Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Openstack-Api-Version: compute 2.90 Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Openstack-System-Scope: None Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: User-Agent: python-novaclient Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Auth-Token: gAAAAABjDZCF8C5fCqdBCarcrxeCMrFov42zFeyd2Rnx3B_5gkREBspTQ4YWKBAox8y0NyfF7WOFg4OUsF11AVJIZxKFJuueJdS8GIXteNYtav4V3dGVUuPEvHwP-QQQqwrsBLhfH88GgIRthnkgTNvXvURSqBuUJC6JhZOZnXMsn6bBdqN91gA Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Domain-Id: None Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Domain-Name: None Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Identity-Status: Confirmed Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Is-Admin-Project: True Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Domain-Id: default Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Domain-Name: Default Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Name: admin Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Role: admin,member,reader Aug 30 04:22:30.377621 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Roles: admin,member,reader Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant: admin Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant-Name: admin Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User: admin Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Domain-Id: default Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Domain-Name: Default Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Id: 7a4a4a4d468841a8acfbd6ef778ab3bd Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Name: admin Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: method: > Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: exception: Flavor 84 could not be found. Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: action_args: {'id': '84'} Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:30.380054 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:30.381943 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.384775 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-2a1e9420-8e23-4bb8-9a67-1776d61ae11c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:30.387027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-2a1e9420-8e23-4bb8-9a67-1776d61ae11c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.515841 Aug 30 04:22:30.387027 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 23/44] 10.222.0.91 () {60 vars in 1190 bytes} [Tue Aug 30 04:22:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:30.393719 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-4b2e445f-ca72-466c-a3a3-462d84651db1 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.411029 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-4b2e445f-ca72-466c-a3a3-462d84651db1 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020964 Aug 30 04:22:30.411626 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 22/45] 10.222.0.91 () {60 vars in 1210 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:30.422978 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-7398e56c-d92f-4db8-8d18-23f8ab174b9b admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.441426 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-7398e56c-d92f-4db8-8d18-23f8ab174b9b admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022187 Aug 30 04:22:30.442024 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 24/46] 10.222.0.91 () {60 vars in 1210 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:30.453231 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-35735317-032e-4a3f-952e-75911fe4b2cb admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.460144 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.wsgi [None req-35735317-032e-4a3f-952e-75911fe4b2cb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-35735317-032e-4a3f-952e-75911fe4b2cb admin admin] Request method failure captured: Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Accept: application/json Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Accept-Encoding: gzip, deflate Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Connection: keep-alive Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Content-Length: 0 Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Host: 10.222.0.91 Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Openstack-Api-Version: compute 2.90 Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Openstack-System-Scope: None Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: User-Agent: python-novaclient Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Auth-Token: gAAAAABjDZCF8C5fCqdBCarcrxeCMrFov42zFeyd2Rnx3B_5gkREBspTQ4YWKBAox8y0NyfF7WOFg4OUsF11AVJIZxKFJuueJdS8GIXteNYtav4V3dGVUuPEvHwP-QQQqwrsBLhfH88GgIRthnkgTNvXvURSqBuUJC6JhZOZnXMsn6bBdqN91gA Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Domain-Id: None Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Domain-Name: None Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Identity-Status: Confirmed Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Is-Admin-Project: True Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Domain-Id: default Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Domain-Name: Default Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Name: admin Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Role: admin,member,reader Aug 30 04:22:30.461757 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Roles: admin,member,reader Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant: admin Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant-Name: admin Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User: admin Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Domain-Id: default Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Domain-Name: Default Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Id: 7a4a4a4d468841a8acfbd6ef778ab3bd Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Name: admin Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: method: > Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: exception: Flavor 84 could not be found. Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: action_args: {'id': '84'} Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:30.464210 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:30.465726 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:30.467818 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-35735317-032e-4a3f-952e-75911fe4b2cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:30.469937 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-35735317-032e-4a3f-952e-75911fe4b2cb admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014037 Aug 30 04:22:30.469937 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 23/47] 10.222.0.91 () {60 vars in 1190 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:31.576634 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-7398e56c-d92f-4db8-8d18-23f8ab174b9b admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:31.578097 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-7398e56c-d92f-4db8-8d18-23f8ab174b9b admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Aug 30 04:22:31.578797 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 25/48] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:32.247771 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-c91f6e47-528a-4660-a327-fb3a43df435e admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.254727 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.wsgi [None req-c91f6e47-528a-4660-a327-fb3a43df435e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-c91f6e47-528a-4660-a327-fb3a43df435e admin admin] Request method failure captured: Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Accept: application/json Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Accept-Encoding: gzip, deflate Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Connection: keep-alive Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Content-Length: 0 Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Host: 10.222.0.91 Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Openstack-Api-Version: compute 2.90 Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Openstack-System-Scope: None Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: User-Agent: python-novaclient Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Auth-Token: gAAAAABjDZCHPTgnW4mJ8BveULVYsD2B1qUCXh7A__ar7a83dXQQvok8L3IsfxdHbI4pGEApdeG7ov8NWbPcGFWIeO4wdFMPwnfLg59VgPizKZW4g8o4nxy5y-jhcprbN3Rw2SN8ytMjKsvkbeUjPxw1YHA-6t4YyrRu-diHRXlhEPcynfJKXnA Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Domain-Id: None Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Domain-Name: None Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Identity-Status: Confirmed Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Is-Admin-Project: True Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Domain-Id: default Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Domain-Name: Default Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Project-Name: admin Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Role: admin,member,reader Aug 30 04:22:32.256330 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Roles: admin,member,reader Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant: admin Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-Tenant-Name: admin Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User: admin Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Domain-Id: default Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Domain-Name: Default Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Id: 7a4a4a4d468841a8acfbd6ef778ab3bd Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: X-User-Name: admin Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: method: > Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: exception: Flavor 451 could not be found. Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: action_args: {'id': '451'} Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:32.258898 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:32.260785 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.263356 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-c91f6e47-528a-4660-a327-fb3a43df435e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:32.265729 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-c91f6e47-528a-4660-a327-fb3a43df435e admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.509898 Aug 30 04:22:32.265729 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 24/49] 10.222.0.91 () {60 vars in 1193 bytes} [Tue Aug 30 04:22:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:32.270702 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-6a9d319c-7757-4a93-bb0c-969e7444a0d6 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.288938 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-6a9d319c-7757-4a93-bb0c-969e7444a0d6 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021894 Aug 30 04:22:32.289533 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 26/50] 10.222.0.91 () {60 vars in 1210 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:32.300737 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.318723 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021727 Aug 30 04:22:32.319421 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 25/51] 10.222.0.91 () {60 vars in 1210 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:32.330762 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-c72dce51-e6b4-4c5b-b640-f4cfb0371740 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.337307 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.wsgi [None req-c72dce51-e6b4-4c5b-b640-f4cfb0371740 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-c72dce51-e6b4-4c5b-b640-f4cfb0371740 admin admin] Request method failure captured: Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Accept: application/json Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Accept-Encoding: gzip, deflate Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Connection: keep-alive Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Content-Length: 0 Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Host: 10.222.0.91 Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Openstack-Api-Version: compute 2.90 Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Openstack-System-Scope: None Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: User-Agent: python-novaclient Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Auth-Token: gAAAAABjDZCHPTgnW4mJ8BveULVYsD2B1qUCXh7A__ar7a83dXQQvok8L3IsfxdHbI4pGEApdeG7ov8NWbPcGFWIeO4wdFMPwnfLg59VgPizKZW4g8o4nxy5y-jhcprbN3Rw2SN8ytMjKsvkbeUjPxw1YHA-6t4YyrRu-diHRXlhEPcynfJKXnA Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Domain-Id: None Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Domain-Name: None Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Identity-Status: Confirmed Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Is-Admin-Project: True Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Domain-Id: default Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Domain-Name: Default Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Project-Name: admin Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Role: admin,member,reader Aug 30 04:22:32.338942 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Roles: admin,member,reader Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d17736c99d5e4774b6a5a802cbcd44ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant: admin Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant-Id: d17736c99d5e4774b6a5a802cbcd44ca Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-Tenant-Name: admin Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User: admin Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Domain-Id: default Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Domain-Name: Default Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Id: 7a4a4a4d468841a8acfbd6ef778ab3bd Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: X-User-Name: admin Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: method: > Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: exception: Flavor 451 could not be found. Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: action_args: {'id': '451'} Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:32.341341 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:32.342443 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.344754 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-c72dce51-e6b4-4c5b-b640-f4cfb0371740 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:32.346587 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-c72dce51-e6b4-4c5b-b640-f4cfb0371740 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013492 Aug 30 04:22:32.346587 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 27/52] 10.222.0.91 () {60 vars in 1193 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:22:33.457894 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:33.459044 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Aug 30 04:22:33.459521 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 26/53] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:22:34.187836 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-7fbace3d-93a2-405c-aabf-a813ac064fa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:34.215725 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-7fbace3d-93a2-405c-aabf-a813ac064fa2 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.614454 Aug 30 04:22:34.216972 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 28/54] 10.222.0.91 () {64 vars in 1235 bytes} [Tue Aug 30 04:22:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:35.410383 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.411534 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Aug 30 04:22:35.412070 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 27/55] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:36.061642 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-60e014cb-aacc-49b8-a522-1a83da180f58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:36.083976 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-60e014cb-aacc-49b8-a522-1a83da180f58 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.522499 Aug 30 04:22:36.084796 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 29/56] 10.222.0.91 () {64 vars in 1235 bytes} [Tue Aug 30 04:22:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:37.181852 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:37.182938 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 30 04:22:37.183348 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 28/57] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:37.941379 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-244bf6a6-62a9-4963-ae82-b4ecf0428182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:37.975030 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-244bf6a6-62a9-4963-ae82-b4ecf0428182 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.532511 Aug 30 04:22:37.976131 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 30/58] 10.222.0.91 () {64 vars in 1235 bytes} [Tue Aug 30 04:22:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:39.042964 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:39.044125 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Aug 30 04:22:39.044555 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 29/59] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:39.684364 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-426dbd0f-9245-4e65-aab0-ee0250712f85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:39.708905 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-426dbd0f-9245-4e65-aab0-ee0250712f85 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.524271 Aug 30 04:22:39.709658 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 31/60] 10.222.0.91 () {64 vars in 1235 bytes} [Tue Aug 30 04:22:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:40.828580 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:40.829634 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Aug 30 04:22:40.830108 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 30/61] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:22:41.701872 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-4bf507b1-8a43-44dd-af79-05bc10833645 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:41.729402 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-4bf507b1-8a43-44dd-af79-05bc10833645 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.632216 Aug 30 04:22:41.730001 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 32/62] 10.222.0.91 () {60 vars in 1202 bytes} [Tue Aug 30 04:22:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:43.334362 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.335274 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6a4ac17c-e800-40b6-bb14-958037fb6076 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001874 Aug 30 04:23:43.335681 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 31/63] 10.222.0.91 () {54 vars in 931 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:43.353281 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:43.926092 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-e8b779ab-2692-4a9e-a6cb-f17a48913293 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.951127 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-e8b779ab-2692-4a9e-a6cb-f17a48913293 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.607483 Aug 30 04:23:43.951740 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 33/64] 10.222.0.91 () {60 vars in 1292 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:43.975833 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG dbcounter [-] [105609] Writing DB stats nova_api:SELECT=14 {{(pid=105609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:43.980270 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-6dc3d5ab-aacf-4105-bf7c-6f4e726bd671 admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.990295 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-6dc3d5ab-aacf-4105-bf7c-6f4e726bd671 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015533 Aug 30 04:23:43.990907 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 32/65] 10.222.0.91 () {60 vars in 1283 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:44.004906 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-3b209995-8d32-4607-bc36-9bbc39515e85 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.015435 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-3b209995-8d32-4607-bc36-9bbc39515e85 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014987 Aug 30 04:23:44.016366 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 34/66] 10.222.0.91 () {60 vars in 1286 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:44.029279 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.038924 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013046 Aug 30 04:23:44.039524 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 33/67] 10.222.0.91 () {60 vars in 1286 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:44.052693 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-0d5dfc14-7ea2-4012-8ced-92886a8d7929 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.062124 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-0d5dfc14-7ea2-4012-8ced-92886a8d7929 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013291 Aug 30 04:23:44.062711 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 35/68] 10.222.0.91 () {60 vars in 1283 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:01.831467 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:01.832638 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001772 Aug 30 04:27:01.833056 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 34/69] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:01.975781 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_api:SELECT=6 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:02.142048 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:02.146184 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.146857 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.147623 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.148837 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.149344 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.149761 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.191618 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-3bb6e6c2-1ca3-4a65-96b1-3820e4385ef9 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.217417 Aug 30 04:27:02.192233 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 36/70] 10.222.0.91 () {60 vars in 1193 bytes} [Tue Aug 30 04:27:01 2022] GET /compute/v2.1/os-services => generated 785 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:27:03.131816 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:03.133125 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Aug 30 04:27:03.133513 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 35/71] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:03.366033 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:03.370359 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.370842 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.371283 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.372081 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.372517 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.373023 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.395218 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-8f62c7a4-ab66-4af9-ad0f-f987616b6c63 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.102433 Aug 30 04:27:03.395955 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 37/72] 10.222.0.91 () {60 vars in 1193 bytes} [Tue Aug 30 04:27:03 2022] GET /compute/v2.1/os-services => generated 785 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:27:14.741981 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:14.743666 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002341 Aug 30 04:27:14.744221 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 36/73] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:27:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:14.895617 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_cell0:SELECT=4 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:14.896297 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_cell1:SELECT=4 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:14.896900 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG dbcounter [-] [105610] Writing DB stats nova_api:SELECT=8 {{(pid=105610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:14.951186 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:14.954964 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.956019 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.956497 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.957254 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.957744 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.958224 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.986845 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-133f5083-1d5c-4e98-8f92-fd0e31d47544 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.096365 Aug 30 04:27:14.987503 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 38/74] 10.222.0.91 () {60 vars in 1193 bytes} [Tue Aug 30 04:27:14 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:15.833567 dv-cinder-854265-2-smb devstack@n-api.service[105609]: DEBUG nova.api.openstack.wsgi [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] Calling method '>' {{(pid=105609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:15.834597 dv-cinder-854265-2-smb devstack@n-api.service[105609]: INFO nova.api.openstack.requestlog [None req-74004cc0-7e7b-4139-8f19-b4544f0866fa admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 30 04:27:15.835032 dv-cinder-854265-2-smb devstack@n-api.service[105609]: [pid: 105609|app: 0|req: 37/75] 10.222.0.91 () {56 vars in 1074 bytes} [Tue Aug 30 04:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:16.039492 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG nova.api.openstack.wsgi [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] Calling method '>' {{(pid=105610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:16.042875 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.043343 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.043883 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.045018 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.045478 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.046050 dv-cinder-854265-2-smb devstack@n-api.service[105610]: DEBUG oslo_concurrency.lockutils [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.073285 dv-cinder-854265-2-smb devstack@n-api.service[105610]: INFO nova.api.openstack.requestlog [None req-5ab1ffe7-ad60-441d-8018-410e4c4f17bc admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.095377 Aug 30 04:27:16.073872 dv-cinder-854265-2-smb devstack@n-api.service[105610]: [pid: 105610|app: 0|req: 39/76] 10.222.0.91 () {60 vars in 1193 bytes} [Tue Aug 30 04:27:15 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:18.806398 dv-cinder-854265-2-smb devstack@n-api.service[105608]: Tue Aug 30 04:28:18 2022 - graceful shutdown triggered... Aug 30 04:28:18.805920 dv-cinder-854265-2-smb systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 04:28:18.807809 dv-cinder-854265-2-smb devstack@n-api.service[105609]: Gracefully killing worker 1 (pid: 105609)... Aug 30 04:28:18.810297 dv-cinder-854265-2-smb devstack@n-api.service[105610]: Gracefully killing worker 2 (pid: 105610)... Aug 30 04:28:19.806846 dv-cinder-854265-2-smb devstack@n-api.service[105608]: worker 1 buried after 1 seconds Aug 30 04:28:19.806846 dv-cinder-854265-2-smb devstack@n-api.service[105608]: worker 2 buried after 1 seconds Aug 30 04:28:19.806846 dv-cinder-854265-2-smb devstack@n-api.service[105608]: goodbye to uWSGI. Aug 30 04:28:19.808528 dv-cinder-854265-2-smb systemd[1]: devstack@n-api.service: Succeeded. Aug 30 04:28:19.809210 dv-cinder-854265-2-smb systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 04:28:19.812567 dv-cinder-854265-2-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 04:28:19.823956 dv-cinder-854265-2-smb devstack@n-api.service[120826]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:28:19 2022] *** Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: nodename: dv-cinder-854265-2-smb Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: machine: x86_64 Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: clock source: unix Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: pcre jit disabled Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: detected number of CPU cores: 4 Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: current working directory: / Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:28:19.827397 dv-cinder-854265-2-smb devstack@n-api.service[120826]: your processes number limit is 47680 Aug 30 04:28:19.828799 dv-cinder-854265-2-smb devstack@n-api.service[120826]: your memory page size is 4096 bytes Aug 30 04:28:19.828799 dv-cinder-854265-2-smb devstack@n-api.service[120826]: detected max file descriptor number: 2048 Aug 30 04:28:19.828799 dv-cinder-854265-2-smb devstack@n-api.service[120826]: lock engine: pthread robust mutexes Aug 30 04:28:19.828799 dv-cinder-854265-2-smb devstack@n-api.service[120826]: thunder lock: enabled Aug 30 04:28:19.828799 dv-cinder-854265-2-smb devstack@n-api.service[120826]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 04:28:19.828799 dv-cinder-854265-2-smb devstack@n-api.service[120826]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:28:19.893053 dv-cinder-854265-2-smb devstack@n-api.service[120826]: Python main interpreter initialized at 0x557b9c9b69c0 Aug 30 04:28:19.893053 dv-cinder-854265-2-smb devstack@n-api.service[120826]: python threads support enabled Aug 30 04:28:19.893053 dv-cinder-854265-2-smb devstack@n-api.service[120826]: your server socket listen backlog is limited to 100 connections Aug 30 04:28:19.893053 dv-cinder-854265-2-smb devstack@n-api.service[120826]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:28:19.893634 dv-cinder-854265-2-smb devstack@n-api.service[120826]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:28:19.893634 dv-cinder-854265-2-smb devstack@n-api.service[120826]: *** Operational MODE: preforking *** Aug 30 04:28:19.893925 dv-cinder-854265-2-smb devstack@n-api.service[120826]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:28:19.893925 dv-cinder-854265-2-smb devstack@n-api.service[120826]: spawned uWSGI master process (pid: 120826) Aug 30 04:28:19.895214 dv-cinder-854265-2-smb devstack@n-api.service[120826]: spawned uWSGI worker 1 (pid: 120846, cores: 1) Aug 30 04:28:19.894247 dv-cinder-854265-2-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 30 04:28:19.895451 dv-cinder-854265-2-smb devstack@n-api.service[120826]: spawned uWSGI worker 2 (pid: 120847, cores: 1) Aug 30 04:28:19.895626 dv-cinder-854265-2-smb devstack@n-api.service[120826]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:28:20.642884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:28:21.142819 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:28:22.311711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:28:22.311711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: from cryptography.utils import int_from_bytes Aug 30 04:28:22.312790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:28:22.312790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: from cryptography.utils import int_from_bytes Aug 30 04:28:22.562048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:28:22.562048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: from cryptography.utils import int_from_bytes Aug 30 04:28:22.562863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:28:22.562863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: from cryptography.utils import int_from_bytes Aug 30 04:28:26.015388 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:28:26.016302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:28:26.016302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:28:26.016591 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:28:26.017012 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:28:26.017208 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.017516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.017840 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.018156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.018656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.018964 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.019377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.019797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.020438 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.020885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.021418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.021868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-smb {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.022358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.022681 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.023006 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.023332 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.023640 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.023990 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.024305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.024811 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.025267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.028105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.029325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.029325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-smb {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.029715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.030243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.030739 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.034760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.036654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.036852 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.037287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.037827 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.038335 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.038885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.039563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.039982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.040415 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.040952 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.041446 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.041877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.042262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.042588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.042890 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.043260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.043701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.044185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.044545 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.044898 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.045279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.045636 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.045989 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.046352 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.046705 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.047897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.047897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.047897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.048394 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.048532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.049029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.049328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.049767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.050167 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.050785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.051301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.051748 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.052238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.052685 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.053122 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.053572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.054001 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.054393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.054746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.055043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.055393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.055746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.056170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.056527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.056880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.057280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.057625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.058094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.058622 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.058838 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.059142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.059501 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.059972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.060425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.060864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.061320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.061772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.062223 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.062656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.063088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.063514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.064044 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.064499 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.064935 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.065371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.065815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.066277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.066714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.067153 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.067582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.068061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.068511 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.068942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.069366 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.069812 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.070267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.070762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.071262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.071756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.072262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.072643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.073017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.073433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.073797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.074302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.074702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.075081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.075485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.075837 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.076912 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.077391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.077793 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.078204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.078583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.078980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.079379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.079763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.080286 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.080869 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.081367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.082315 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.082639 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.083117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.083439 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.083876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.084320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.084750 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.085204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.085599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.086025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.086427 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.086850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.087199 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.087616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.088064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.089317 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.089317 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.089317 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.089650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.089955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.090291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.090797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.091097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.091548 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.091970 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.092448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.092998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.093525 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.093983 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.094435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.094956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.095408 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.095858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.096385 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.096855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.097379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.097846 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.098299 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.098846 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.099403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.099986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.100550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.100971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.101506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.102045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.102522 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.102900 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.103364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.103904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.104396 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.104911 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.105401 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.105859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.106318 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.107443 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.107443 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.107867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.108390 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.108800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.109356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.109785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.110235 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.110809 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.111294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.112280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.112559 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.114129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.114399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.114965 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.115526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.116104 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.116748 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.117424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.117916 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.118409 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.118866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.119477 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.121579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.122143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.122618 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.123102 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.123640 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.124180 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.124684 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.125233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.125798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.126283 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.126723 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.127191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.127640 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.128179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.128968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.129527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.129979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.130496 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.131020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.131481 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.132028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.132545 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.133133 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.133768 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.134292 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.134758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.135220 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.135676 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.136267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.136802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.137356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.137777 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.138170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.138551 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.138951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.139391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.139781 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.140290 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.142269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.142269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.142269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.142269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.142269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.142728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.142903 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.143643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.144063 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.144847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.144847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.145674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.146199 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.146959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.147296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.148842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.148842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.149359 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.149599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.150003 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.150819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.151598 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.152407 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.152937 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.153478 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.154053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.154769 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.155053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.155443 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.155891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.156431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.157457 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.157908 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.158398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.158798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.159207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.160532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.160532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.160532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.161480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.161962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.162495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.163062 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.163616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.164109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.164555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.165073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.165475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.165856 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.166239 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.166684 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.167187 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.167568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.167976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.168370 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.168758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.169135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.169523 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.169900 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.170275 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.170667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.171055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.171431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.171809 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.172214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.172606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.173096 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.173496 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.173924 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.174389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.174768 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.175239 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.175810 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.176392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.177172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.177616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.177997 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.178484 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.179021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.179556 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.180618 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.181151 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.181535 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.181910 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.184061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.184061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.184061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.184061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.184061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.184598 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.184922 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.185381 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.185753 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.186138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.186593 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.187106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.187624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.188108 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.188564 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.189027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.189492 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.189941 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.190440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.190849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.191475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.191991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.193556 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.194065 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.194617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.195316 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.195634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.196172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.196745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.197294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.197817 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.198318 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.198832 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.199328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.199813 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.200398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.201432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.201967 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.202373 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.202884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.203307 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.203800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.204314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.204707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.205231 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.205882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.206414 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.206995 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.207554 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.207842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.208432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.208918 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.209473 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.210032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.210613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.211181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.211695 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.212292 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.212758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.213140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.213513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.213895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.214263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.214638 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.215116 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.215799 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.216168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.216597 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.217082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.217603 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.218077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.218462 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.218868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.219312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.219690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.220198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.220715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.221105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.221567 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.222000 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.222944 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.223486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.224040 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.224470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.224992 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.225511 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.225961 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.226420 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.226880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.227389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.227845 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.228355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.228797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.229259 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.229716 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.230180 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.230628 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.231080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.231555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.232109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.232613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.233089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.233560 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.234036 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.234492 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.234952 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.235420 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.235877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.236422 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.236840 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.237294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.237775 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.238358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.238814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.239274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.239725 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.240282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.240754 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.241212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.241696 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.242192 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.242625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.243280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.244723 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.244723 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.244723 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.245606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.245943 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.246806 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.247107 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.247454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.248066 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.248534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.249000 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.249508 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.250111 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.250574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.251233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.251673 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.252341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.252948 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.253337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.254021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.254460 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.254998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.255449 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.255954 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.256412 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.256980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.257569 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.258023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.258481 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.259056 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.259513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.260020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.260506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.261812 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.261812 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.262330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.262682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.263144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.263614 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.264206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.264664 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.265136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.265660 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.266080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.266562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.267225 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.267563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.268264 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.268752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.269278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.269741 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.270211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.270670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.271115 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.271610 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.272114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.272572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.273048 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.273506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.273962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.274420 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.274881 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.275327 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.275784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.276333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.276784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.277483 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.277844 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.278316 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.278777 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.279367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.279801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.280362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.280843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.281563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.281837 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.283286 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.283286 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.283825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.284268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.284600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.285217 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.285704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.286534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.286998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.287466 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.288073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.291043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.291043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.291043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.291043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.291043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.291450 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.291906 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.292491 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.293008 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.293558 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.294164 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.294701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.295356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.296026 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.296706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.297226 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.297771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.298383 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.298916 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.299511 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.300083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.300888 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.301484 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.301983 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.302555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.303121 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.303680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.304282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.304876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.305393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.305942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.306504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.307068 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.308094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.308671 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.309243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.309801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.310354 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.310936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.311497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.312077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.312624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.313185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.313747 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.314333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.314969 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.315469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.317017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.317328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.318055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.318577 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.319133 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.319753 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.320308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.320849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.321415 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.322116 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.322624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.323197 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.323742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.324350 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.324918 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.325478 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.326040 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.326606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.327181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.327750 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.328364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.328934 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.329504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.330084 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.330666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.332095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.332891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.333170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.333736 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.334321 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.334864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.335473 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.337095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.337095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.337461 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.337982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.338526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.339055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.339647 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.340238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.340802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.341359 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.341935 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.343093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.343707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.344293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.344886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.345455 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.346015 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.346579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.347113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.348447 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.348964 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.349546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.350119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.350685 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.351240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.351771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.352336 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.352814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.353355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.353890 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.354426 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.354935 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.355456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.356045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.356603 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.357153 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.357658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.358206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.358746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.359280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.359902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.360497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.361028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.361578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.362209 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.362724 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.363495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.364385 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.364943 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.365940 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.366599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.367145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.367734 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.368319 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.368870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.369498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.370074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.371276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.371667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.372279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.372874 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.373483 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.374030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.374596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.375149 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.375741 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.376331 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.376910 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.377453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.378070 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.379524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.379762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.381253 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.381253 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.382056 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.382418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.382997 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.383561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.384178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.384780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.385599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.386502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.387329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.388194 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.389023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.389861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.391346 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.392009 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.392345 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.394833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.394833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.394833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.394833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.395354 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.395354 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.395711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.396081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.396419 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.398580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.398580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.398580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.398580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.398580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.398580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.399982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.399982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.399982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.399982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.400851 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.400851 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.401296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.401648 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.402155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.402760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.403076 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.403572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.403968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.404282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.404600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.404915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.405225 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.405571 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.405879 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.406182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.406545 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.407313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.407313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.407724 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.408049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.408426 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.408746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.409271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.409555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.410858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.410858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.410858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.411858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.412307 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.412673 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.413006 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.413319 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.413651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.413976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.414305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.414624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.414963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.415272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.415672 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.415892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.416229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.416541 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.416859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.417352 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.417862 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.418379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.418743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.419065 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.419399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.419709 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.420064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.420399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.420706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.421016 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.421326 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.421641 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.421956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.422365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.422573 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.422884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.423270 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.423589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.424057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.424567 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.424970 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.425213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.425710 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.426134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.426451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.426924 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.427342 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.427601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.427825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.428083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.428275 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:28:26.494590 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO dbcounter [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Registered counter for database nova_api Aug 30 04:28:26.520452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_db.sqlalchemy.engines [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:26.532384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writer thread running {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:26.543245 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:28:26.543809 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:28:26.544595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:28:26.545239 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:28:26.545718 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:28:26.546405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.547219 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.547789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.548439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.549081 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.549826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.550656 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.551530 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.551878 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.552388 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.553028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.553641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-smb {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.554239 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.554828 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.555390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.556005 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.556560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.557371 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.557945 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.558939 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.559572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.560166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.560720 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.561332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.561897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.562463 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.563044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.563623 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.564273 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.564853 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.565579 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-smb {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.566172 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.567061 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.567472 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.569666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.569666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.569666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.570059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.570595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.571168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.571790 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.572405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.572992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.573577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.574134 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.574732 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.575276 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.575847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.576432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.577010 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.577628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.578182 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.578781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.579362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.579956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.580418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.584479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.584479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.584479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.584479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.584479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.584479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.586386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.586386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.586386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.587106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.587474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.588089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.588671 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.589267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.589861 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.590450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.591187 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.594147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.594147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.594147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.594147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.594147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.595342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.595342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.595646 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.598125 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.599009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.599631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.600324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.600891 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.601367 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.601925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.602498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.603088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.603665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.604603 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.605181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.605745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.606322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.606913 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.607531 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.608267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.608839 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.610289 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.610891 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.611463 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.612398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.613567 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.614272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.context [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f61739b9-662a-4f7a-9573-4e7676b7b5de(cell1) {{(pid=120846) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:28:26.614664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.615257 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.615838 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.616450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.617028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.617616 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.618460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.618831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.619001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.619470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.619670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.620173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.620735 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.621325 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.621485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.621907 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.622245 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.622482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.623043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.623234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.623638 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.624236 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.624921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.625488 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.626050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.626763 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.627019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.627195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.627645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.628245 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.629046 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.629618 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.630174 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.631969 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.632112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO dbcounter [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Registered counter for database nova_cell0 Aug 30 04:28:26.632222 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.632222 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.632605 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.633068 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.633874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:28:26.634283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.634898 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.635584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.636191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.636736 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.637350 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.637939 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.638538 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.639320 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.639764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO dbcounter [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Registered counter for database nova_cell1 Aug 30 04:28:26.640142 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.640628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.641221 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.641806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.642410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.642996 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.644258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.644258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.645775 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.645775 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.646034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.646605 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.647168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.647760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.648501 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.651586 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.651586 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.651838 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_db.sqlalchemy.engines [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:26.651993 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.651993 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.651993 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.652254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.652794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.653342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.653588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_db.sqlalchemy.engines [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:26.654066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.654484 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.655059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.655684 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.656376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.656968 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.657547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.658132 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.658703 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.658887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writer thread running {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:26.659489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.661521 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.662154 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.662987 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.663825 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.664464 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.666046 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.666650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.667204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.667780 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.668434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.669540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.670106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.670680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.671492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.672085 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.672676 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.673283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.673858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.674675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.675035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.677182 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.677182 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.677542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.679023 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.679023 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.679221 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.679955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.680572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.681202 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.681929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.682295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.682865 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.683433 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.684105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.684630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.685454 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.686760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.686760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.687197 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.688116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.688709 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.689335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.689979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.690550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.691199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.692241 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.692465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.692976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.693540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.694341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.694899 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.695433 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.696712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.697383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.697975 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.698542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.699107 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.699646 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.700319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.700915 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.702088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.702088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.702658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.703278 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.703852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.704744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.705372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.706148 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.706552 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.708154 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.708154 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.708692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.708924 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.709497 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.710079 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.710664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.711256 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.711864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.713951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.713951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.713951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.714610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.714923 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.715767 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.716428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.717221 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.717630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.718563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.719444 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.720076 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.720666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.721229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.721784 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.722855 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.723000 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.723546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.724176 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.724743 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.725371 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.725926 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.726645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.727086 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.727961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.728354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.729281 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.729570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.730134 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.730652 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.731231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.731800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.732425 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.732984 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.733559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.734133 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.734723 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.735306 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.735888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.737339 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.737339 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.738405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.738405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.738860 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.739398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.739992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.740542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.741303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.741605 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.742138 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.742660 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.743197 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.743738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.744419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.745731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.745731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.746136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.746560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.747098 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.747683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.748485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.748921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.749478 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.750063 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.750616 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.751220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.751824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.755419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.756084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.757296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.757296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.758153 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.758826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.759280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.760231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.760763 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.761292 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.761875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.762342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.763261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.763620 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.764098 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.764438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.765391 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.765391 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.765733 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.765918 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.766109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.766422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.766882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.767076 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.767323 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.767673 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.768530 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.770837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.770837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.770837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.770837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.770837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.770837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.772504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.772504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.772504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.772504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.772504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.772504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.773950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.773950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.773950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.773950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.774568 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.774568 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.774910 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.775298 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.775573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.776003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.776952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.777508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.777801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.778122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.778431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.778746 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.784366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.788963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.788963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.788963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.788963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.788963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.788963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.788963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.790547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.790547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.790547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.790547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.790547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.791696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.791696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.791696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.796401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.796401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.797303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.797303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.797303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.798193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.798193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.801490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.802540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.802540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.802540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.803937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.803937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.803937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.803937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.805078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.805078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.805078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.805078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.806022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.806022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.806022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.806022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.806961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.806961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.806961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.808008 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.808008 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.808008 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.808685 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.808685 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.809191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.809191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.809654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.809654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.810128 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.810476 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.810713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.810963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.811195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.811442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.811876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.812204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.813228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.813228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.813542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.814281 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.814617 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.815084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.815349 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.815650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.816531 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.822124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.823220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.824418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.824418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.824418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.824418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.824418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.825396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.825705 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.826099 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.826423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.826686 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.826944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.827343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.827700 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.828041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.828369 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.831642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.834409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.836821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.838613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.838613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.838613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.838613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.838613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.838613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.840354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.840354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.840354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.840354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.841278 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.841278 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.841737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.841737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.842206 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.842459 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.842710 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.842946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.843434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.843699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.843995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.844258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.844648 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.845198 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.845198 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.845835 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.846109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.846368 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.852228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.855403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.858166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.860129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.861897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.864427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.867386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.869214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.871017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.871017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.871017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.871017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.871017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.872177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.872177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.872177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.872823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.872823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.873310 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.873310 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.873768 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.873768 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.874246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.874890 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.875226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.875668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.875977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.876254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.876575 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.877638 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.877638 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.878124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.878124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.880389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.880389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.880389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.880389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.880389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.881865 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writer thread running {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:26.882129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.882452 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.883197 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.883197 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.884056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.884056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.884519 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.884519 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.885160 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.885160 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.885635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.885635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.886308 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.886308 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.887026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.887026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.888428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.888428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.888889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.889147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.889391 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.889638 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.890628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.890628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.890628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.891512 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.891512 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.891512 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.894417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.898629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.898629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.898629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.898629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.898629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.899946 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO dbcounter [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Registered counter for database nova_cell0 Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.900596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.902559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.904482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.904482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.904482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.904482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.907428 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_db.sqlalchemy.engines [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:26.907816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.908996 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.908996 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.909553 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.909870 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.911424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.911424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.914247 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.914866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.915374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.915703 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.916119 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.916667 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.916946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.917371 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.918976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.919450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.919741 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.920150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.920696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.920964 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writer thread running {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:26.921236 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.921756 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.922283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.922981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.923371 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.923986 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.924552 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.925106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.925776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.925776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.927318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.927318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.927811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.927811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.928373 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.928373 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.930744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.930744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.930744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.930744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.930744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.930744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.930744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.932641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.932641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.932641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.932641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.932641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.934140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.934140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.934140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.934140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.934140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.935411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.935411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.935411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.935411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.936630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.937121 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.939376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.939806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.941304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.941304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.941304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.941304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.945267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.947322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.949824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.952333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.954526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.954526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.954526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.954526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.954526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.954526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.954526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.956282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.956282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.956282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.956282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.956282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.956282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.958785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.960397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.960397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.960397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.960397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.960397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.962903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.962903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.962903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.962903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:28:26.962903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:28:27.166032 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO dbcounter [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Registered counter for database nova_api Aug 30 04:28:27.200100 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_db.sqlalchemy.engines [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:27.212440 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writer thread running {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:27.308307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.context [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f61739b9-662a-4f7a-9573-4e7676b7b5de(cell1) {{(pid=120847) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:28:27.312766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.313257 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.315187 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.318088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.318088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.319744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.321333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO dbcounter [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Registered counter for database nova_cell0 Aug 30 04:28:27.329584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO dbcounter [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Registered counter for database nova_cell1 Aug 30 04:28:27.346663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_db.sqlalchemy.engines [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:27.348060 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_db.sqlalchemy.engines [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:27.359188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writer thread running {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:27.362000 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writer thread running {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:27.453855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: WARNING keystonemiddleware.auth_token [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:28:27.464195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: WARNING keystonemiddleware.auth_token [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:28:27.569368 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO dbcounter [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Registered counter for database nova_cell0 Aug 30 04:28:27.578727 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_db.sqlalchemy.engines [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:28:27.585377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writer thread running {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:28:27.905233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: WARNING keystonemiddleware.auth_token [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:28:27.916673 dv-cinder-854265-2-smb devstack@n-api.service[120846]: WARNING keystonemiddleware.auth_token [None req-270b73c1-0b41-4525-98c7-1dfa6764cd0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:28:27.926054 dv-cinder-854265-2-smb devstack@n-api.service[120847]: WARNING keystonemiddleware.auth_token [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:28:27.926454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x557b9c9b69c0 pid: 120846 (default app) Aug 30 04:28:27.933851 dv-cinder-854265-2-smb devstack@n-api.service[120847]: WARNING keystonemiddleware.auth_token [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:28:28.306355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: WARNING keystonemiddleware.auth_token [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:28:28.312729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: WARNING keystonemiddleware.auth_token [None req-cdc61876-2690-43b6-88f7-0e0b12b31013 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:28:28.318424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x557b9c9b69c0 pid: 120847 (default app) Aug 30 04:29:10.951575 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:10.953959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:10.955089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:10.958962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:11.157948 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:11.159775 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:11.161812 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:11.163027 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:12.902358 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cc07ed2d-afa8-4957-a364-1f55468449e4 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Action: 'create', calling method: .version_select at 0x7f24ed62be50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1303880889"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:13.061176 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-35ec5c30-9584-4951-9703-debccb401bdc tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Action: 'create', calling method: .version_select at 0x7f24ed678e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-607584601", "metadata": {"Type": "work"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-35ec5c30-9584-4951-9703-debccb401bdc tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Request method failure captured: Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 121 Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIWSv52aIGG0Gygj8oJYmrVW-bJOjf1rbG-iwXsU7NEGgCQwFvWTH2fwcpPjDr8PojM524DCq_kqk9gk6JNm79euUA3HFCFMVWeKA6DdvvEi3D2cwlnVHnAUmXZDWhZmA9fFjCBm6EcVyCacijghZk9juR62JQr-La4lqeFiFUfx1E Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:13.073787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 368463f2e7464a068e2585471246c4b5 Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-607584601", "metadata": {"Type": "work"}}} Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:13.075570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-607584601', 'metadata': {'Type': 'work'}}}} Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:13.076608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:29:13.078249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:29:13.079674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:29:13.079674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.098293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-35ec5c30-9584-4951-9703-debccb401bdc tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:13.102452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-35ec5c30-9584-4951-9703-debccb401bdc tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.163991 Aug 30 04:29:13.105983 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 1/1] 10.222.0.91 () {60 vars in 1156 bytes} [Tue Aug 30 04:29:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:29:13.119172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e2e2d1f6-bfb6-4081-839c-988907b79524 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Action: 'create', calling method: .version_select at 0x7f24ed5c3940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1816204322", "metadata": {"Type": "work"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e2e2d1f6-bfb6-4081-839c-988907b79524 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Request method failure captured: Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 120 Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIWSv52aIGG0Gygj8oJYmrVW-bJOjf1rbG-iwXsU7NEGgCQwFvWTH2fwcpPjDr8PojM524DCq_kqk9gk6JNm79euUA3HFCFMVWeKA6DdvvEi3D2cwlnVHnAUmXZDWhZmA9fFjCBm6EcVyCacijghZk9juR62JQr-La4lqeFiFUfx1E Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:13.125868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 368463f2e7464a068e2585471246c4b5 Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1816204322", "metadata": {"Type": "work"}}} Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:13.127742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1816204322', 'metadata': {'Type': 'work'}}}} Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi '0' Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:13.129456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:29:13.131138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:29:13.132598 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:29:13.132598 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.141262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e2e2d1f6-bfb6-4081-839c-988907b79524 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:13.142475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e2e2d1f6-bfb6-4081-839c-988907b79524 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029857 Aug 30 04:29:13.146544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 2/2] 10.222.0.91 () {60 vars in 1156 bytes} [Tue Aug 30 04:29:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:29:13.158466 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b01b8549-5507-486b-9af5-e2df43dd91be tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Action: 'create', calling method: .version_select at 0x7f24ed5299d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1632129680", "metadata": {"Type": "work"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b01b8549-5507-486b-9af5-e2df43dd91be tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Request method failure captured: Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 119 Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIWSv52aIGG0Gygj8oJYmrVW-bJOjf1rbG-iwXsU7NEGgCQwFvWTH2fwcpPjDr8PojM524DCq_kqk9gk6JNm79euUA3HFCFMVWeKA6DdvvEi3D2cwlnVHnAUmXZDWhZmA9fFjCBm6EcVyCacijghZk9juR62JQr-La4lqeFiFUfx1E Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:13.168843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 368463f2e7464a068e2585471246c4b5 Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1632129680", "metadata": {"Type": "work"}}} Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:13.170502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1632129680', 'metadata': {'Type': 'work'}}}} Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi '' Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:13.171568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:29:13.173902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:29:13.175589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:29:13.175589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:13.179702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b01b8549-5507-486b-9af5-e2df43dd91be tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:13.180771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b01b8549-5507-486b-9af5-e2df43dd91be tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027832 Aug 30 04:29:13.182461 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 3/3] 10.222.0.91 () {60 vars in 1156 bytes} [Tue Aug 30 04:29:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:29:13.214264 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4383cf01-6228-46b2-9715-763a09c2694c tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Calling method '.version_select at 0x7f24ed529700>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:14.172801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-4383cf01-6228-46b2-9715-763a09c2694c tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] HTTP exception thrown: Volume tempest-invalid-1357363159 could not be found. Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4383cf01-6228-46b2-9715-763a09c2694c tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Request method failure captured: Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1357363159 HTTP/1.1 Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIWSv52aIGG0Gygj8oJYmrVW-bJOjf1rbG-iwXsU7NEGgCQwFvWTH2fwcpPjDr8PojM524DCq_kqk9gk6JNm79euUA3HFCFMVWeKA6DdvvEi3D2cwlnVHnAUmXZDWhZmA9fFjCBm6EcVyCacijghZk9juR62JQr-La4lqeFiFUfx1E Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:14.177078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 368463f2e7464a068e2585471246c4b5 Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Volume tempest-invalid-1357363159 could not be found. Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'tempest-invalid-1357363159'} Aug 30 04:29:14.179875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1357363159 could not be found. (HTTP 404) (Request-ID: req-c83c415f-648b-47e0-bb21-690cc5a74caa) Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.182037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:29:14.251855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1357363159 could not be found. Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:14.257706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1357363159 could not be found. Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1357363159 could not be found. Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4383cf01-6228-46b2-9715-763a09c2694c tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Returning 404 to user: Volume tempest-invalid-1357363159 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4383cf01-6228-46b2-9715-763a09c2694c tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1357363159" status: 404 len: 99 microversion: 2.1 time: 0.981165 Aug 30 04:29:14.261392 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 4/4] 10.222.0.91 () {58 vars in 1218 bytes} [Tue Aug 30 04:29:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1357363159 => generated 99 bytes in 984 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:29:14.264166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-83385798-70b6-4f25-be66-394e673f07e7 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004732 Aug 30 04:29:14.264166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 5/5] 10.222.0.91 () {58 vars in 1140 bytes} [Tue Aug 30 04:29:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 30 04:29:14.264166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-483a83cc-cb22-4394-bee0-e0a328983e84 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013884 Aug 30 04:29:14.264166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 6/6] 10.222.0.91 () {58 vars in 1137 bytes} [Tue Aug 30 04:29:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:29:14.264166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4fa7b233-2ca8-4cd5-8dd9-5f7c63f58280 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Calling method '.version_select at 0x7f24ed489ca0>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:14.350258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-4fa7b233-2ca8-4cd5-8dd9-5f7c63f58280 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] HTTP exception thrown: Volume 5e01b373-6cd7-443d-9294-d8b9e3860f1b could not be found. Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4fa7b233-2ca8-4cd5-8dd9-5f7c63f58280 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Request method failure captured: Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/os-volumes/5e01b373-6cd7-443d-9294-d8b9e3860f1b HTTP/1.1 Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIWSv52aIGG0Gygj8oJYmrVW-bJOjf1rbG-iwXsU7NEGgCQwFvWTH2fwcpPjDr8PojM524DCq_kqk9gk6JNm79euUA3HFCFMVWeKA6DdvvEi3D2cwlnVHnAUmXZDWhZmA9fFjCBm6EcVyCacijghZk9juR62JQr-La4lqeFiFUfx1E Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:14.354291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 368463f2e7464a068e2585471246c4b5 Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Volume 5e01b373-6cd7-443d-9294-d8b9e3860f1b could not be found. Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '5e01b373-6cd7-443d-9294-d8b9e3860f1b'} Aug 30 04:29:14.356362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e01b373-6cd7-443d-9294-d8b9e3860f1b could not be found. (HTTP 404) (Request-ID: req-52f45250-6d16-40c0-bf9d-6d304638e171) Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.357435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:29:14.361117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e01b373-6cd7-443d-9294-d8b9e3860f1b could not be found. Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:29:14.366939 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e01b373-6cd7-443d-9294-d8b9e3860f1b could not be found. Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e01b373-6cd7-443d-9294-d8b9e3860f1b could not be found. Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.371027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4fa7b233-2ca8-4cd5-8dd9-5f7c63f58280 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Returning 404 to user: Volume 5e01b373-6cd7-443d-9294-d8b9e3860f1b could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:14.378584 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4fa7b233-2ca8-4cd5-8dd9-5f7c63f58280 tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/5e01b373-6cd7-443d-9294-d8b9e3860f1b" status: 404 len: 109 microversion: 2.1 time: 0.142399 Aug 30 04:29:14.382448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 7/7] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:29:14 2022] DELETE /compute/v2.1/os-volumes/5e01b373-6cd7-443d-9294-d8b9e3860f1b => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:14.415088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-53d06924-1234-41a4-ba9b-28ddf027bebb tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Calling method '.version_select at 0x7f24ed4eb790>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:14.511967 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-53d06924-1234-41a4-ba9b-28ddf027bebb tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] HTTP exception thrown: Volume b96d797b-f6bc-4a87-98f0-99f172ba3785 could not be found. Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-53d06924-1234-41a4-ba9b-28ddf027bebb tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Request method failure captured: Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/os-volumes/b96d797b-f6bc-4a87-98f0-99f172ba3785 HTTP/1.1 Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIWSv52aIGG0Gygj8oJYmrVW-bJOjf1rbG-iwXsU7NEGgCQwFvWTH2fwcpPjDr8PojM524DCq_kqk9gk6JNm79euUA3HFCFMVWeKA6DdvvEi3D2cwlnVHnAUmXZDWhZmA9fFjCBm6EcVyCacijghZk9juR62JQr-La4lqeFiFUfx1E Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:14.521517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/eba9fe072ea34323bbebbc34c646cd3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: eba9fe072ea34323bbebbc34c646cd3f Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesNegativeTest-1929662220 Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 368463f2e7464a068e2585471246c4b5 Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesNegativeTest-1929662220-project Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Volume b96d797b-f6bc-4a87-98f0-99f172ba3785 could not be found. Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'b96d797b-f6bc-4a87-98f0-99f172ba3785'} Aug 30 04:29:14.523594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b96d797b-f6bc-4a87-98f0-99f172ba3785 could not be found. (HTTP 404) (Request-ID: req-6edf0f5d-2e9c-49c4-91f5-8632cfa1560f) Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.525143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:14.529196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b96d797b-f6bc-4a87-98f0-99f172ba3785 could not be found. Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:29:14.531800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b96d797b-f6bc-4a87-98f0-99f172ba3785 could not be found. Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b96d797b-f6bc-4a87-98f0-99f172ba3785 could not be found. Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-53d06924-1234-41a4-ba9b-28ddf027bebb tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] Returning 404 to user: Volume b96d797b-f6bc-4a87-98f0-99f172ba3785 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-53d06924-1234-41a4-ba9b-28ddf027bebb tempest-VolumesNegativeTest-1929662220 tempest-VolumesNegativeTest-1929662220-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b96d797b-f6bc-4a87-98f0-99f172ba3785" status: 404 len: 109 microversion: 2.1 time: 0.136756 Aug 30 04:29:14.537855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 8/8] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:14 2022] GET /compute/v2.1/os-volumes/b96d797b-f6bc-4a87-98f0-99f172ba3785 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:14.790952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cc07ed2d-afa8-4957-a364-1f55468449e4 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.662377 Aug 30 04:29:14.792112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 1/9] 10.222.0.91 () {60 vars in 1155 bytes} [Tue Aug 30 04:29:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3668 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 04:29:14.813151 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c3199d6c-b2f4-42f2-950f-541241d3ad7a tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed529310>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.006781 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c3199d6c-b2f4-42f2-950f-541241d3ad7a tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a" status: 200 len: 345 microversion: 2.1 time: 0.201732 Aug 30 04:29:15.009185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 9/10] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:14 2022] GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:16.073444 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c5a2f7c9-0cb5-49e8-a6fc-01f6915cc9cd tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed4b0ca0>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:16.381802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c5a2f7c9-0cb5-49e8-a6fc-01f6915cc9cd tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a" status: 200 len: 346 microversion: 2.1 time: 0.359791 Aug 30 04:29:16.394949 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 2/11] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:16 2022] GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a => generated 346 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:16.405842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-de8c4b73-44d4-4444-9b1b-3138a8030d46 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Action: 'create', calling method: .version_select at 0x7f24ed489430>, body: {"snapshot": {"volume_id": "ab127deb-3ba7-4046-8265-e0b64ae71d4a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-247164962"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:17.360561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-de8c4b73-44d4-4444-9b1b-3138a8030d46 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.963295 Aug 30 04:29:17.361742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 10/12] 10.222.0.91 () {60 vars in 1162 bytes} [Tue Aug 30 04:29:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:17.373731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6fcecf24-a630-4ea1-b99f-473535414850 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed4c43a0>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.796040 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6fcecf24-a630-4ea1-b99f-473535414850 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda" status: 200 len: 286 microversion: 2.1 time: 0.426177 Aug 30 04:29:17.797481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 3/13] 10.222.0.91 () {58 vars in 1251 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda => generated 286 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:17.815324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d99f9d98-da63-4bca-9e82-ec630da8eda1 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed421ca0>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.934743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d99f9d98-da63-4bca-9e82-ec630da8eda1 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.127337 Aug 30 04:29:17.937221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 11/14] 10.222.0.91 () {58 vars in 1140 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:17.953965 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4c89b762-bc94-4cff-ab02-5eeb032aafe3 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed4c4af0>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:18.054014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4c89b762-bc94-4cff-ab02-5eeb032aafe3 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda" status: 200 len: 287 microversion: 2.1 time: 0.105444 Aug 30 04:29:18.062577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 4/15] 10.222.0.91 () {58 vars in 1251 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:18.084825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-19975d30-bb0f-4389-baef-884b1e7ec14f tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed421160>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:18.271773 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-19975d30-bb0f-4389-baef-884b1e7ec14f tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "DELETE /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda" status: 202 len: 0 microversion: 2.1 time: 0.195222 Aug 30 04:29:18.285177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 12/16] 10.222.0.91 () {58 vars in 1254 bytes} [Tue Aug 30 04:29:18 2022] DELETE /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:18.290754 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fb16c7ec-0bf3-490e-9f3c-3bab14429997 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed4b0d30>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:18.448135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fb16c7ec-0bf3-490e-9f3c-3bab14429997 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda" status: 200 len: 286 microversion: 2.1 time: 0.167791 Aug 30 04:29:18.451020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 5/17] 10.222.0.91 () {58 vars in 1251 bytes} [Tue Aug 30 04:29:18 2022] GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:19.489345 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5b4fd909-b2f0-4d0a-b202-049f3233bcde tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed4898b0>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.604583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-5b4fd909-b2f0-4d0a-b202-049f3233bcde tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] HTTP exception thrown: Snapshot 1ca60a66-d4fb-4b13-9853-c4471ab78fda could not be found. Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5b4fd909-b2f0-4d0a-b202-049f3233bcde tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Request method failure captured: Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda HTTP/1.1 Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIXPXD-ptopy5xUuRKzpSDp5j8b7c1H4Hf9TSNieeFiSeuviZw0UGOl4n5zkbdxy4MYymIN5osHTEWZkD8JkfaITO6QHjyx-2eL6ztOu4gHacGvl2z5cpC7QTuJ2iZHsHbUApewRC0XI-1jfb2Yr0UYn82l7bcpi-CW9CtoussjHAs Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:19.608228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: b66e74b0f3a84d3b90c81a6ae587ba85 Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Snapshot 1ca60a66-d4fb-4b13-9853-c4471ab78fda could not be found. Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '1ca60a66-d4fb-4b13-9853-c4471ab78fda'} Aug 30 04:29:19.609384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1ca60a66-d4fb-4b13-9853-c4471ab78fda could not be found. (HTTP 404) (Request-ID: req-9d4be51d-b0e2-4431-9ff0-61e6036c1528) Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:19.610060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:19.611021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1ca60a66-d4fb-4b13-9853-c4471ab78fda could not be found. Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 04:29:19.612691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1ca60a66-d4fb-4b13-9853-c4471ab78fda could not be found. Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1ca60a66-d4fb-4b13-9853-c4471ab78fda could not be found. Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5b4fd909-b2f0-4d0a-b202-049f3233bcde tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Returning 404 to user: Snapshot 1ca60a66-d4fb-4b13-9853-c4471ab78fda could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:19.614682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5b4fd909-b2f0-4d0a-b202-049f3233bcde tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda" status: 404 len: 111 microversion: 2.1 time: 0.146801 Aug 30 04:29:19.615396 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 13/18] 10.222.0.91 () {58 vars in 1251 bytes} [Tue Aug 30 04:29:19 2022] GET /compute/v2.1/os-snapshots/1ca60a66-d4fb-4b13-9853-c4471ab78fda => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:19.622972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-091ebf9f-16b7-4071-8e2d-e6e4ad04bccb tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed4c4a60>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.849659 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-091ebf9f-16b7-4071-8e2d-e6e4ad04bccb tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a" status: 202 len: 0 microversion: 2.1 time: 0.230802 Aug 30 04:29:19.851031 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 6/19] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:29:19 2022] DELETE /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:19.865254 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-601ef973-03f3-459e-817a-8d8f6656dcfd tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed421280>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:20.076822 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-601ef973-03f3-459e-817a-8d8f6656dcfd tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a" status: 200 len: 345 microversion: 2.1 time: 0.217719 Aug 30 04:29:20.077407 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 14/20] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:19 2022] GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:21.100883 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ea7c2ea4-8497-42ba-a92d-c133e9ac1a60 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed4c4310>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.169150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-ea7c2ea4-8497-42ba-a92d-c133e9ac1a60 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] HTTP exception thrown: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ea7c2ea4-8497-42ba-a92d-c133e9ac1a60 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Request method failure captured: Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a HTTP/1.1 Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZIXPXD-ptopy5xUuRKzpSDp5j8b7c1H4Hf9TSNieeFiSeuviZw0UGOl4n5zkbdxy4MYymIN5osHTEWZkD8JkfaITO6QHjyx-2eL6ztOu4gHacGvl2z5cpC7QTuJ2iZHsHbUApewRC0XI-1jfb2Yr0UYn82l7bcpi-CW9CtoussjHAs Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:29:21.173682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: b66e74b0f3a84d3b90c81a6ae587ba85 Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'ab127deb-3ba7-4046-8265-e0b64ae71d4a'} Aug 30 04:29:21.175226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. (HTTP 404) (Request-ID: req-b3ce0d90-7d55-4d41-83e8-3890abcffa68) Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.176520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:21.177574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:29:21.178698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.179830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.185912 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ea7c2ea4-8497-42ba-a92d-c133e9ac1a60 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Returning 404 to user: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:21.191355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ea7c2ea4-8497-42ba-a92d-c133e9ac1a60 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a" status: 404 len: 109 microversion: 2.1 time: 0.094339 Aug 30 04:29:21.193728 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 7/21] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:21.208764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7c126eb4-2250-4517-91ec-29225b52e235 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed489280>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.275958 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-7c126eb4-2250-4517-91ec-29225b52e235 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] HTTP exception thrown: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7c126eb4-2250-4517-91ec-29225b52e235 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Request method failure captured: Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a HTTP/1.1 Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIXPXD-ptopy5xUuRKzpSDp5j8b7c1H4Hf9TSNieeFiSeuviZw0UGOl4n5zkbdxy4MYymIN5osHTEWZkD8JkfaITO6QHjyx-2eL6ztOu4gHacGvl2z5cpC7QTuJ2iZHsHbUApewRC0XI-1jfb2Yr0UYn82l7bcpi-CW9CtoussjHAs Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:29:21.279260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: b66e74b0f3a84d3b90c81a6ae587ba85 Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'ab127deb-3ba7-4046-8265-e0b64ae71d4a'} Aug 30 04:29:21.280454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. (HTTP 404) (Request-ID: req-6996533c-b4fd-4141-9a28-e7466e2ec501) Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.281175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:29:21.282085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:29:21.283252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.287606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.291963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7c126eb4-2250-4517-91ec-29225b52e235 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Returning 404 to user: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:21.293684 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7c126eb4-2250-4517-91ec-29225b52e235 tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a" status: 404 len: 109 microversion: 2.1 time: 0.091793 Aug 30 04:29:21.298220 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 15/22] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:29:21 2022] DELETE /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:21.313963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6c527dd1-f1fe-4b63-aaba-998d5f22253f tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Calling method '.version_select at 0x7f24ed431550>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.401363 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-6c527dd1-f1fe-4b63-aaba-998d5f22253f tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] HTTP exception thrown: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6c527dd1-f1fe-4b63-aaba-998d5f22253f tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Request method failure captured: Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a HTTP/1.1 Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZIXPXD-ptopy5xUuRKzpSDp5j8b7c1H4Hf9TSNieeFiSeuviZw0UGOl4n5zkbdxy4MYymIN5osHTEWZkD8JkfaITO6QHjyx-2eL6ztOu4gHacGvl2z5cpC7QTuJ2iZHsHbUApewRC0XI-1jfb2Yr0UYn82l7bcpi-CW9CtoussjHAs Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:29:21.408351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/13f8a3965e8d4b0ab2dc90fb59cd5916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 13f8a3965e8d4b0ab2dc90fb59cd5916 Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671385950 Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: b66e74b0f3a84d3b90c81a6ae587ba85 Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671385950-project Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'ab127deb-3ba7-4046-8265-e0b64ae71d4a'} Aug 30 04:29:21.410437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. (HTTP 404) (Request-ID: req-99c7cffc-4b52-44d5-826c-a9daf3e702da) Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.413578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:29:21.416028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:29:21.417139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:29:21.420348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6c527dd1-f1fe-4b63-aaba-998d5f22253f tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] Returning 404 to user: Volume ab127deb-3ba7-4046-8265-e0b64ae71d4a could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:21.424162 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6c527dd1-f1fe-4b63-aaba-998d5f22253f tempest-VolumesSnapshotsTestJSON-1671385950 tempest-VolumesSnapshotsTestJSON-1671385950-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a" status: 404 len: 109 microversion: 2.1 time: 0.123163 Aug 30 04:29:21.427488 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 8/23] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/os-volumes/ab127deb-3ba7-4046-8265-e0b64ae71d4a => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:22.485540 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1920590083", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "networks": [{"uuid": "24fcffe4-e95e-443e-99de-67df22e64732"}]}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:22.802831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] validate_networks() for [('24fcffe4-e95e-443e-99de-67df22e64732', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:28.013969 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:28.017448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:28.019129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:28.020376 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:28.021693 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:28.054578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.056356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.057806 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.059661 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.061428 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.075369 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.187552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Getting quotas for project 0a8ee9d47bc94efca1f8c216349b0809. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:28.223345 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Getting quotas for user 364abb1a054f45c3b95ac2f5714763a0 and project 0a8ee9d47bc94efca1f8c216349b0809. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:28.260129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:28.263207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:28.460924 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-46eee62a-0bf7-4ab6-869f-1e35caf104bd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.304774 Aug 30 04:29:28.464659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 16/24] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 6309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:29:28.489046 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1a6e863c-079c-42cb-8584-651ae5c78198 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:28.498755 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1a6e863c-079c-42cb-8584-651ae5c78198 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:29.229134 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1a6e863c-079c-42cb-8584-651ae5c78198 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.337607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1a6e863c-079c-42cb-8584-651ae5c78198 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1215 microversion: 2.1 time: 0.862772 Aug 30 04:29:29.358394 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 9/25] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:28 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1215 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:30.403279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-47cfe8eb-2939-4d4b-85f3-b164bed0edea tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:30.406037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-47cfe8eb-2939-4d4b-85f3-b164bed0edea tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:30.931771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-47cfe8eb-2939-4d4b-85f3-b164bed0edea tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:31.023330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-47cfe8eb-2939-4d4b-85f3-b164bed0edea tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1215 microversion: 2.1 time: 0.639719 Aug 30 04:29:31.048709 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 17/26] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:30 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1215 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:32.092203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-785b5d5c-ee6d-41c5-95ae-0c599ea0b13c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:32.096364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-785b5d5c-ee6d-41c5-95ae-0c599ea0b13c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:32.492629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-785b5d5c-ee6d-41c5-95ae-0c599ea0b13c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.549396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-785b5d5c-ee6d-41c5-95ae-0c599ea0b13c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1215 microversion: 2.1 time: 0.481938 Aug 30 04:29:32.557420 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 10/27] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:32 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1215 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:33.396351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-274c2465-5890-4073-b14a-9adc7c4dc16b tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ecb34f70>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:33.599186 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:33.600859 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:33.630861 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.635128 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.638625 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.647184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.648763 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.650821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.692546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-274c2465-5890-4073-b14a-9adc7c4dc16b tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/c37069e5-ef40-4e36-beb1-29d338e8e21b" status: 200 len: 350 microversion: 2.1 time: 0.311933 Aug 30 04:29:33.700716 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 18/28] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:33 2022] GET /compute/v2.1/os-volumes/c37069e5-ef40-4e36-beb1-29d338e8e21b => generated 350 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:34.455938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.536769 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4bd5300d-5d14-49d3-b9e1-f461bbc4a4aa tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1267 microversion: 2.1 time: 0.943219 Aug 30 04:29:34.547434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 11/29] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:33 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1267 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:35.578951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:35.579892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:35.609743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.610328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.610783 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.615849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.616957 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.616957 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.085238 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-145fef69-8560-4c89-a100-20ef542343bf tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ed37aa60>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.228102 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-145fef69-8560-4c89-a100-20ef542343bf tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/56a2425a-6a9c-41aa-97ad-3b280f7b17b7" status: 200 len: 351 microversion: 2.1 time: 0.168668 Aug 30 04:29:36.231967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 12/30] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:36 2022] GET /compute/v2.1/os-volumes/56a2425a-6a9c-41aa-97ad-3b280f7b17b7 => generated 351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:36.480448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.516451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2783e00a-df0f-4c10-bfcd-ab01de889c8f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1273 microversion: 2.1 time: 0.943511 Aug 30 04:29:36.533301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 19/31] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:35 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1273 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:37.546701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:37.547972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:37.587506 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.595885 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.603889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.606506 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.613280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.624945 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.024321 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:38.033396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d08a1890-100f-401f-84f0-5c4b05587c37 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1273 microversion: 2.1 time: 0.497579 Aug 30 04:29:38.043500 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 13/32] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:37 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1273 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:38.608402 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fcbc7727-68c3-4e3f-a18e-e7ff755aaaed tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24eca5bd30>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:38.625224 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:38.950302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fcbc7727-68c3-4e3f-a18e-e7ff755aaaed tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/7ceef60f-a92a-4d86-8472-89ab56e551a8" status: 200 len: 351 microversion: 2.1 time: 0.346593 Aug 30 04:29:38.951543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 20/33] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:29:38 2022] GET /compute/v2.1/os-volumes/7ceef60f-a92a-4d86-8472-89ab56e551a8 => generated 351 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:38.972876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a37c9557-de74-4151-bfbc-60f96cf78214 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ed404e50>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:39.064854 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:39.065840 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:39.122971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.127817 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.149218 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.165688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.173807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.179666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.427126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a37c9557-de74-4151-bfbc-60f96cf78214 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.464295 Aug 30 04:29:39.433872 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 14/34] 10.222.0.91 () {58 vars in 1134 bytes} [Tue Aug 30 04:29:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:39.482878 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e30b2f4e-5616-4c28-8877-a65ac4ea4773 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ed333c10>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:39.988794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.022061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-585a6354-3676-49ac-be12-81fe0c621550 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1273 microversion: 2.1 time: 0.965189 Aug 30 04:29:40.037653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 21/35] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:39 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1273 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:40.114203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e30b2f4e-5616-4c28-8877-a65ac4ea4773 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.658126 Aug 30 04:29:40.117842 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 15/36] 10.222.0.91 () {58 vars in 1149 bytes} [Tue Aug 30 04:29:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:40.144572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-254b07ac-cac9-4b2a-95fc-934097a0ccdf tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24eca8ce50>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:40.657921 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-254b07ac-cac9-4b2a-95fc-934097a0ccdf tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.518664 Aug 30 04:29:40.673229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 22/37] 10.222.0.91 () {58 vars in 1134 bytes} [Tue Aug 30 04:29:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:40.679834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-92fe691d-2db8-4982-8678-d3fc40e28261 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ed34e550>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:41.047225 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=8 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:41.137964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-92fe691d-2db8-4982-8678-d3fc40e28261 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.467349 Aug 30 04:29:41.139558 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 16/38] 10.222.0.91 () {58 vars in 1167 bytes} [Tue Aug 30 04:29:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:41.147008 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:41.153137 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:41.170993 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.173308 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.177655 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.178957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.179679 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.186275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.457771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-462326df-c868-4b02-a364-eeb44d405a2c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'create', calling method: .version_select at 0x7f24eca2d550>, body: {"keypair": {"name": "tempest-keypair-1411464138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGTfO2R3OivL6DwGKn7IRi7zGhfVeSb02wCMJOfaEBIgZ5yC3fnpwhu7cYbiS5gMwQJk4LgSPpJAKG/++SR2vGey5BRxs9VNlVzohW6RJtZYOE15LbFyOqKT5gJ1NN9Wg=="}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:41.563990 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-462326df-c868-4b02-a364-eeb44d405a2c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for project cf24ec2c8bd74974932690a583961691. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:41.585972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-462326df-c868-4b02-a364-eeb44d405a2c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for user 91067603d9c549278cdc2d97b54cca88 and project cf24ec2c8bd74974932690a583961691. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:41.650534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:41.659489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-10f02e5a-0471-40cc-8bb3-1c9b418344a3 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 0.518312 Aug 30 04:29:41.666841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 17/39] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:41 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:41.688238 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-92a7ea32-e7f7-47d3-b43e-2446f785323b tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ed62bf70>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:41.802850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-462326df-c868-4b02-a364-eeb44d405a2c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.767549 Aug 30 04:29:41.808149 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 23/40] 10.222.0.91 () {62 vars in 1200 bytes} [Tue Aug 30 04:29:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 770 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:29:42.091045 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-92a7ea32-e7f7-47d3-b43e-2446f785323b tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.419298 Aug 30 04:29:42.092142 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 18/41] 10.222.0.91 () {58 vars in 1170 bytes} [Tue Aug 30 04:29:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:42.139831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-31aefb91-76e2-4d6a-abbb-35fb67a8f029 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24eca2d160>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.556596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-31aefb91-76e2-4d6a-abbb-35fb67a8f029 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.449987 Aug 30 04:29:42.572876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 24/42] 10.222.0.91 () {58 vars in 1155 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:42.589851 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a53f7290-fd69-4203-8b36-70971ef37d62 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ed31f040>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.615141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=4 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:42.712488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.724848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:42.767802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.782194 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.792701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.796824 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.797336 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.797788 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.059776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a53f7290-fd69-4203-8b36-70971ef37d62 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.476683 Aug 30 04:29:43.069330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 19/43] 10.222.0.91 () {58 vars in 1188 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:43.074884 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2c349440-5e79-4143-8451-5f5bd8e098f2 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] Calling method '.version_select at 0x7f24ed37a5e0>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:43.449840 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2c349440-5e79-4143-8451-5f5bd8e098f2 tempest-VolumesTestJSON-800282946 tempest-VolumesTestJSON-800282946-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.379087 Aug 30 04:29:43.450410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 20/44] 10.222.0.91 () {58 vars in 1155 bytes} [Tue Aug 30 04:29:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:44.341394 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.356184 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e4db2c40-f15f-4263-b8d8-c35430cd2025 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 1.664974 Aug 30 04:29:44.360645 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 25/45] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:45.393093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:45.395730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:45.423514 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.428513 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.433067 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.435009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.438560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.443791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.334472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1152600961", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:46.679364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] validate_networks() for [('1d802dd7-2559-4337-b25d-332df8c6e9ad', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:47.835539 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.896737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a8607115-672b-426c-a9d4-3ffac7aa7c5b tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 2.502976 Aug 30 04:29:47.908136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 21/46] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:45 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 2518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:49.033808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cfa29897-f787-44ea-82cf-806ff0cd2d7b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'create', calling method: .version_select at 0x7f24ed333af0>, body: {"keypair": {"name": "tempest-keypair-1217156936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR4Zs0OvxXG2qb22H7jIQt09/nDxvrz0ur0qHZAu6GrB8s66rHt/RGZU0hMX7QCSgtrA/wkqNdxC75plPHOOrUD2G/eINdXqbwwZ7w6yUk0O2m0uyT0pHQimeMXJN8GSg=="}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:49.206098 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-cfa29897-f787-44ea-82cf-806ff0cd2d7b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:49.236104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-cfa29897-f787-44ea-82cf-806ff0cd2d7b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for user 9a872454622d41ce9462890af418182d and project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:49.471317 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cfa29897-f787-44ea-82cf-806ff0cd2d7b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.562041 Aug 30 04:29:49.485554 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 22/47] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:29:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:49.527300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:49.531982 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:49.567865 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.568706 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.569159 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.572572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.573064 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.573507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.905211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:50.905982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:50.906140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:50.906560 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:50.907029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:50.942033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.947678 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.948468 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.959223 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.959722 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.960199 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.061632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:51.080293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for user 589bd91dbf434099b15ed7a8680f93bb and project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:51.133533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:51.137979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:51.204615 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:51.278980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ffa6bbf2-e273-4532-a543-e31d2bf08446 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.637038 Aug 30 04:29:51.280059 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 26/48] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 5639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:29:51.929042 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-aed863d1-e933-4d5d-b2ae-38ebee4d7e7a req-e94cbaf8-799b-48f3-bc1b-9af5b72c4e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ad200a-0b2a-4bf1-8d08-2e48447b0c31", "tag": "17d9b26c-46af-4399-b1cd-5ae925d73d03"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:51.975550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-aed863d1-e933-4d5d-b2ae-38ebee4d7e7a req-e94cbaf8-799b-48f3-bc1b-9af5b72c4e12 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.976448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-aed863d1-e933-4d5d-b2ae-38ebee4d7e7a req-e94cbaf8-799b-48f3-bc1b-9af5b72c4e12 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.977284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-aed863d1-e933-4d5d-b2ae-38ebee4d7e7a req-e94cbaf8-799b-48f3-bc1b-9af5b72c4e12 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.059363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=23 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:52.063092 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-aed863d1-e933-4d5d-b2ae-38ebee4d7e7a req-e94cbaf8-799b-48f3-bc1b-9af5b72c4e12 service nova] Creating event network-changed:17d9b26c-46af-4399-b1cd-5ae925d73d03 for instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 on hv-cinder-85426 Aug 30 04:29:52.064495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-aed863d1-e933-4d5d-b2ae-38ebee4d7e7a req-e94cbaf8-799b-48f3-bc1b-9af5b72c4e12 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:29:52.065464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-aed863d1-e933-4d5d-b2ae-38ebee4d7e7a req-e94cbaf8-799b-48f3-bc1b-9af5b72c4e12 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:29:52.075215 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.076145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.077336 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.079407 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.080529 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.084860 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.125367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.compute.rpcapi [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:29:52.126867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:29:52.168312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f5f0746f-4c33-4ea1-aaaf-3e64652f86a6 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.886402 Aug 30 04:29:52.169328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 27/49] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:52.183097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-955dd3db-44ba-40bd-b8da-2020997e761a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:52.183828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-955dd3db-44ba-40bd-b8da-2020997e761a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:52.401692 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-955dd3db-44ba-40bd-b8da-2020997e761a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:52.415127 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-955dd3db-44ba-40bd-b8da-2020997e761a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1222 microversion: 2.1 time: 0.244417 Aug 30 04:29:52.428446 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 28/50] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:52 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:52.447848 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:52.488178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-776b904f-9d1d-4ff7-a8cb-1a0e5cb1602f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 3.004777 Aug 30 04:29:52.489483 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 23/51] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:49 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 3011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.261576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-811422263", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:53.468309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] validate_networks() for [('1d802dd7-2559-4337-b25d-332df8c6e9ad', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:53.542203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.543314 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.554257 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:53.555965 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.560643 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.566354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.569841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.570703 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.572964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.228874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.237304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fb4e2672-4c7f-4e30-b9ec-bd927991fe8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 1.699109 Aug 30 04:29:55.257481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 24/52] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:56.274272 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.275305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.302380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.305489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.313674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.318416 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.322408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.331424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.952316 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.987350 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:57.987817 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:57.988224 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:57.988655 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:57.989079 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:57.997156 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-852c059d-b410-4e1b-aefe-e79a0f5f1ef5 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 1.730817 Aug 30 04:29:57.997795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 25/53] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:56 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:58.022165 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.022688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.023139 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.024082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.024555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.024995 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.114066 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:58.136832 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for user 589bd91dbf434099b15ed7a8680f93bb and project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:58.194901 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:58.206019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:58.407150 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-57fad698-3fc4-4927-9c75-23b13ef7b300 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.154126 Aug 30 04:29:58.423973 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-41626fba-6a48-4d0f-9a6f-72a1e53b6a3c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.424878 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-41626fba-6a48-4d0f-9a6f-72a1e53b6a3c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.432825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 29/54] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 5178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:29:58.804619 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-41626fba-6a48-4d0f-9a6f-72a1e53b6a3c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:58.818699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-41626fba-6a48-4d0f-9a6f-72a1e53b6a3c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1221 microversion: 2.1 time: 0.398772 Aug 30 04:29:58.824479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 26/55] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:58 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1221 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:59.025302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:59.026002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:59.050665 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.051333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.051787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.052576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.053038 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.053469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.862195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:59.866018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:59.877081 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.878742 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.879560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.880550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.881192 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.881803 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.031668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.059544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-29394b18-6532-4a82-b850-f114073e8879 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 1.038225 Aug 30 04:30:00.062365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 30/56] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:59 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:00.086551 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.096986 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-76f2f09c-0e94-4c27-9406-ef8853c9ef26 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1225 microversion: 2.1 time: 0.240128 Aug 30 04:30:00.112498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 27/57] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:59 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:00.288589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1115906851", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "169fc8b2-576f-4c43-9cb7-2141fd9da0f6"}], "security_groups": [{"name": "tempest-securitygroup--229597457"}], "key_name": "tempest-keypair-1411464138", "user_data": "}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:00.682897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] validate_networks() for [('169fc8b2-576f-4c43-9cb7-2141fd9da0f6', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:30:00.917867 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1871219279", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bddd7440-d2d5-43f3-9351-36f5944c255c"}], "security_groups": [{"name": "tempest-securitygroup--509046057"}], "key_name": "tempest-keypair-1217156936", "user_data": "}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:01.451841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] validate_networks() for [('bddd7440-d2d5-43f3-9351-36f5944c255c', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:30:01.931322 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:01.932988 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:01.933736 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:01.934454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:01.935145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:01.974432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.975237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.976299 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.977358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.979112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.992123 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.089938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for project cf24ec2c8bd74974932690a583961691. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:02.104109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for user 91067603d9c549278cdc2d97b54cca88 and project cf24ec2c8bd74974932690a583961691. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:02.159261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:02.168665 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:02.307472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-136e1f14-46aa-4697-abdd-1510a576c219 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.027680 Aug 30 04:30:02.312996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 31/58] 10.222.0.91 () {62 vars in 1188 bytes} [Tue Aug 30 04:30:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:30:02.337301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:02.338906 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:02.381812 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.382684 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.383437 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.384756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.385579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.386338 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.015953 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.031277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4ba93bbe-bd3c-489a-8560-64ff742dd01f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 0.714786 Aug 30 04:30:03.032049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 32/59] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:02 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:03.039786 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:03.040606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:03.063398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.063901 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.064363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.065110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.065547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.066083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.325507 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.334451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9e9ac84c-849d-4941-92b3-ab9e28c7002d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1279 microversion: 2.1 time: 0.300838 Aug 30 04:30:03.338978 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 33/60] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:03 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:03.358510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e42d4788-551d-4104-a709-2fab1232e05c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:03.359388 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e42d4788-551d-4104-a709-2fab1232e05c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:03.478082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e42d4788-551d-4104-a709-2fab1232e05c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.505894 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e42d4788-551d-4104-a709-2fab1232e05c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.508703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e42d4788-551d-4104-a709-2fab1232e05c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.511384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e42d4788-551d-4104-a709-2fab1232e05c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1282 microversion: 2.20 time: 0.170229 Aug 30 04:30:03.512811 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 34/61] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:03 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:04.060389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.065053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:04.076041 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.076790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.077624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.078552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.079170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.079730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.456428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:04.458254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:04.459011 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:04.459659 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:04.460355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:04.478747 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.480578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.482580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.486080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.488730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.490064 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.536739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=49 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:04.560437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:04.573023 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for user 9a872454622d41ce9462890af418182d and project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:04.628253 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:04.639373 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:04.716431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.743539 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-402bb277-1917-4a54-957f-6fc0145aef9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 0.685155 Aug 30 04:30:04.757725 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 35/62] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:04 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:04.782290 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-b7052613-4717-4801-8cc4-bb932157e9da req-f634e5ff-869e-491f-9de0-8d169d01ed2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6cd6eb-b345-40aa-9997-edd0e1d35089", "tag": "b63e5ca3-4866-40d2-815c-ec29fddad4bf"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:04.862284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b7052613-4717-4801-8cc4-bb932157e9da req-f634e5ff-869e-491f-9de0-8d169d01ed2a service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.863952 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b7052613-4717-4801-8cc4-bb932157e9da req-f634e5ff-869e-491f-9de0-8d169d01ed2a service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.864704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-dde3a56b-04f3-4fe2-9009-414b26c752ae tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.953283 Aug 30 04:30:04.867778 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b7052613-4717-4801-8cc4-bb932157e9da req-f634e5ff-869e-491f-9de0-8d169d01ed2a service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.879218 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 28/63] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:30:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 3955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:30:04.898544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.899812 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:04.900794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-b7052613-4717-4801-8cc4-bb932157e9da req-f634e5ff-869e-491f-9de0-8d169d01ed2a service nova] Creating event network-changed:b63e5ca3-4866-40d2-815c-ec29fddad4bf for instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 on hv-cinder-85426 Aug 30 04:30:04.914833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-b7052613-4717-4801-8cc4-bb932157e9da req-f634e5ff-869e-491f-9de0-8d169d01ed2a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148748 Aug 30 04:30:04.917978 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 36/64] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:04.920626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.922675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.926485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.929520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.930576 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.932597 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.947465 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.956790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:04.979852 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.983415 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.985263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.990774 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.997573 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.998857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.523313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.569510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.579700 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.582745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-96ef272a-e6db-49e7-b824-f1bf296f4c23 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1342 microversion: 2.20 time: 0.662648 Aug 30 04:30:05.584513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 37/65] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:04 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1342 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:05.596432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e28d782e-f78b-4fc3-af4a-c8dfd5c12bd7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:05.598654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e28d782e-f78b-4fc3-af4a-c8dfd5c12bd7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:05.912465 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e28d782e-f78b-4fc3-af4a-c8dfd5c12bd7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.920336 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e28d782e-f78b-4fc3-af4a-c8dfd5c12bd7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1238 microversion: 2.1 time: 0.333491 Aug 30 04:30:05.924814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 38/66] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:05 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1238 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:05.942421 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:05.943040 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:05.955798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.958278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.960258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.961172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.964277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.965047 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.170231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.185565 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6fb2f90f-87af-4355-8a23-0706c4744f76 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 1.301884 Aug 30 04:30:06.189650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 29/67] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:04 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:06.346053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.360326 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-96bbabd1-f9a2-4218-8307-a36bd796db40 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 0.431463 Aug 30 04:30:06.375625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 39/68] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:05 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:06.612905 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:06.616582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:06.626102 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.627159 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.628232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.629615 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.630825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.632250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.764893 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-3826a0e4-c74b-4681-9d19-a29039c8103e req-ae8d30e3-7d85-4ad3-817a-ad01177f684e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ad200a-0b2a-4bf1-8d08-2e48447b0c31", "name": "network-vif-plugged", "status": "completed", "tag": "17d9b26c-46af-4399-b1cd-5ae925d73d03"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:06.816808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-3826a0e4-c74b-4681-9d19-a29039c8103e req-ae8d30e3-7d85-4ad3-817a-ad01177f684e service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.820557 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-3826a0e4-c74b-4681-9d19-a29039c8103e req-ae8d30e3-7d85-4ad3-817a-ad01177f684e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.821737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-3826a0e4-c74b-4681-9d19-a29039c8103e req-ae8d30e3-7d85-4ad3-817a-ad01177f684e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.869499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-3826a0e4-c74b-4681-9d19-a29039c8103e req-ae8d30e3-7d85-4ad3-817a-ad01177f684e service nova] Creating event network-vif-plugged:17d9b26c-46af-4399-b1cd-5ae925d73d03 for instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 on hv-cinder-85426 Aug 30 04:30:06.870659 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-3826a0e4-c74b-4681-9d19-a29039c8103e req-ae8d30e3-7d85-4ad3-817a-ad01177f684e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120847) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:30:06.871515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-3826a0e4-c74b-4681-9d19-a29039c8103e req-ae8d30e3-7d85-4ad3-817a-ad01177f684e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120847) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:30:06.873707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.874750 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.875664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.877211 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.878372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.879468 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.897525 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.compute.rpcapi [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:30:06.899592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] Releasing lock "compute-rpcapi-router" {{(pid=120847) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:30:06.939649 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f48f97fd-3f5f-44a5-970c-ed135098e95f None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.744968 Aug 30 04:30:06.941423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 30/69] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:06.954696 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.983014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:06.984121 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:06.997991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:07.001058 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:07.003191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4eda6bd1-72cd-4b38-b980-21d262317c1a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1340 microversion: 2.20 time: 0.395734 Aug 30 04:30:07.011832 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.032141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 40/70] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:06 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1340 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:07.051967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.060039 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.067172 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.068464 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.070729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.223487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:07.230333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.260573 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.264818 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.266703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.270296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.276210 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.277495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.914666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:07.944135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cbe3bbc4-29db-4dfd-8a1e-c2e00dceb89d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.729590 Aug 30 04:30:07.947132 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 41/71] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:07 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:07.959426 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:07.962739 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.994168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.995382 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.996495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.998472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:08.000979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:08.002973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.026417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.039022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-30bb4e7e-a71c-4b73-b34c-af9dda98bb66 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1290 microversion: 2.1 time: 1.093839 Aug 30 04:30:08.058366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 31/72] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:06 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1290 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:08.097738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:08.102390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:08.153296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:08.155864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:08.158405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.161110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:08.170877 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:08.179081 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.903007 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.929783 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.933417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.936345 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b41af19a-1c8a-4685-84de-25b3ede2554b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.874104 Aug 30 04:30:08.938185 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 32/73] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:08 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:08.970692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:08.971679 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:09.000822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.001660 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.002364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.003636 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.008874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.013983 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.216309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:09.239045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9bc2c3d8-8d42-4e46-ab34-163bdf7ab2e7 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 1.287771 Aug 30 04:30:09.240404 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 42/74] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:07 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:09.260815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:09.262444 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:09.295870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.298267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.303761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.306074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.310981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.312923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.850442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:09.882831 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ad13bfd7-052f-4e2e-b692-9dafa8f785c5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.918036 Aug 30 04:30:09.884168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 33/75] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:08 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:09.911774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-80a345fd-b0ce-4bc8-8727-eddc053f3765 req-14afddb6-20a5-4a8e-9eee-0dbdf0a3f89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beaafec3-5f47-4d5f-bc1c-76a9d298c6f0", "tag": "6ba6f446-03eb-4bc2-b1f9-d5d271187715"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:09.913194 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:09.936816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-80a345fd-b0ce-4bc8-8727-eddc053f3765 req-14afddb6-20a5-4a8e-9eee-0dbdf0a3f89f service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.937711 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-80a345fd-b0ce-4bc8-8727-eddc053f3765 req-14afddb6-20a5-4a8e-9eee-0dbdf0a3f89f service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.939222 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-80a345fd-b0ce-4bc8-8727-eddc053f3765 req-14afddb6-20a5-4a8e-9eee-0dbdf0a3f89f service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.967409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-80a345fd-b0ce-4bc8-8727-eddc053f3765 req-14afddb6-20a5-4a8e-9eee-0dbdf0a3f89f service nova] Creating event network-changed:6ba6f446-03eb-4bc2-b1f9-d5d271187715 for instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 on hv-cinder-85426 Aug 30 04:30:09.978178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-80a345fd-b0ce-4bc8-8727-eddc053f3765 req-14afddb6-20a5-4a8e-9eee-0dbdf0a3f89f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087050 Aug 30 04:30:09.979657 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 34/76] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:09.980062 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-94e1fe71-5c2c-419d-bec5-23a140c091cc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1296 microversion: 2.1 time: 0.712450 Aug 30 04:30:09.980807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 43/77] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:09 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1296 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:09.991065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:09.992495 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:10.005609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.006677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.007585 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.009181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.010133 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.011296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.264824 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:10.265726 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:10.287005 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.287759 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.289095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.289562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.290645 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.293503 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.022198 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.054578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.057599 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.059630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-72b9206e-6bce-4401-998b-5b537ade8014 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 1.077138 Aug 30 04:30:11.060655 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 35/78] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:09 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:11.133822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.135042 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.184887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.187381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.188758 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.191562 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.193112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.194266 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.570815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.609983 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fcd816f9-9ce3-43ed-8a39-be200c475afd tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 1.351355 Aug 30 04:30:11.624214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 44/79] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:10 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:11.625504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.626132 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.649622 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.650131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.650579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.651320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.651784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.652244 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.841460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.877465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c4043edf-6330-4859-9760-97f5d7652498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.782743 Aug 30 04:30:11.904287 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 36/80] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:11 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:11.992185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.009763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-13c696ea-2259-4c13-a5de-adddc3bf658a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1296 microversion: 2.1 time: 0.392850 Aug 30 04:30:12.010326 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 45/81] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:11 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1296 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:12.138522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:12.153325 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.215016 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.226263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.229180 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.246911 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.247815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.253031 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.621909 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.658647 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:12.666559 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.669461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.684816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.697547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=8 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:12.697849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-793347e8-c48f-4168-806c-b7e232f5ea9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.599391 Aug 30 04:30:12.700804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 37/82] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:12 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:12.710272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.716546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.721323 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.724576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.728864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.730074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.933670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-deef319e-df2b-4066-8da7-fcd94e5e8f41 req-bd0b4360-18c3-4578-a809-c32be4d8faaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:12.954008 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-deef319e-df2b-4066-8da7-fcd94e5e8f41 req-bd0b4360-18c3-4578-a809-c32be4d8faaa service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.954504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-deef319e-df2b-4066-8da7-fcd94e5e8f41 req-bd0b4360-18c3-4578-a809-c32be4d8faaa service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.955067 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-deef319e-df2b-4066-8da7-fcd94e5e8f41 req-bd0b4360-18c3-4578-a809-c32be4d8faaa service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.980284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-deef319e-df2b-4066-8da7-fcd94e5e8f41 req-bd0b4360-18c3-4578-a809-c32be4d8faaa service nova] Creating event network-changed:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:30:12.993631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-deef319e-df2b-4066-8da7-fcd94e5e8f41 req-bd0b4360-18c3-4578-a809-c32be4d8faaa service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212070 Aug 30 04:30:12.996268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 38/83] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:13.030001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:13.036573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:13.059088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.059887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.060665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.061888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.062882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.063791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.385558 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:13.415213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7cd91509-d4f5-4856-a401-9b2e78903efc tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1315 microversion: 2.1 time: 0.767308 Aug 30 04:30:13.421119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 46/84] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:12 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:13.448580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:13.450272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:13.474606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.478844 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.479876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.483637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.485217 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.485963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.513742 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:13.553959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1d963b50-f620-46da-a29f-43c8180b8e71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.538918 Aug 30 04:30:13.561771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 39/85] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:13 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:13.582351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-f8d25634-190d-4fc3-868a-29eb6ab3f5e4 req-db06ab60-4432-4c31-a07a-545083fe60fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6cd6eb-b345-40aa-9997-edd0e1d35089", "name": "network-vif-plugged", "status": "completed", "tag": "b63e5ca3-4866-40d2-815c-ec29fddad4bf"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:13.639970 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-f8d25634-190d-4fc3-868a-29eb6ab3f5e4 req-db06ab60-4432-4c31-a07a-545083fe60fe service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.641543 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-f8d25634-190d-4fc3-868a-29eb6ab3f5e4 req-db06ab60-4432-4c31-a07a-545083fe60fe service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.645470 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-f8d25634-190d-4fc3-868a-29eb6ab3f5e4 req-db06ab60-4432-4c31-a07a-545083fe60fe service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.745329 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-f8d25634-190d-4fc3-868a-29eb6ab3f5e4 req-db06ab60-4432-4c31-a07a-545083fe60fe service nova] Creating event network-vif-plugged:b63e5ca3-4866-40d2-815c-ec29fddad4bf for instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 on hv-cinder-85426 Aug 30 04:30:13.773331 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-f8d25634-190d-4fc3-868a-29eb6ab3f5e4 req-db06ab60-4432-4c31-a07a-545083fe60fe service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206284 Aug 30 04:30:13.791333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 40/86] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:13.842151 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:13.843431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:13.901276 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.907483 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.909261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.913279 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.916974 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.918277 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.608730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=12 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:14.882669 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.896652 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-59bbfe5b-cefe-42c8-bac7-51f9df6a0e84 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 1.473458 Aug 30 04:30:14.904233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 47/87] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:13 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:14.921218 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:14.923082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:14.936689 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.938550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.939454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.941387 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.942215 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.943086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:15.478697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:15.498876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:15.502764 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:15.507114 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d26af468-ee3a-43dd-a199-bd2973c949b2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 1.708652 Aug 30 04:30:15.509580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 41/88] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:13 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:15.526916 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:15.531031 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:15.543441 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:15.544984 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:15.545483 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:15.546902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:15.546902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:15.547204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:15.921391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=28 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:16.218748 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:16.263702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-865e7945-91a8-4a45-8f7b-48add3765c8c tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1503 microversion: 2.1 time: 1.356746 Aug 30 04:30:16.280518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 48/89] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:14 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1503 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:16.312417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:16.319338 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:16.346222 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:16.346765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:16.347331 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:16.358497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:16.359002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:16.362483 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:16.382479 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=100 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:16.416255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:16.449804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a759eb08-f09f-44da-b501-c8c4d1d8a7e1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.937640 Aug 30 04:30:16.452276 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 42/90] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:15 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:16.538291 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:16.543286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:16.582255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:16.591300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:16.592693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:16.595860 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:16.604380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:16.608279 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:16.908623 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=4 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:17.217428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.230671 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.233110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.234324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-33187ecd-5f69-408d-abbf-e6548ba8858b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.704318 Aug 30 04:30:17.235242 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 43/91] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:16 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:17.496817 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:17.498347 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:17.516165 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.516927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:17.517547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:17.518859 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.520018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:17.521086 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:17.943188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.957099 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c0cf484b-57c7-4c08-9d82-1bcb265ae247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 1.674218 Aug 30 04:30:17.959300 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 49/92] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:16 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:18.023959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.071691 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fbbe5231-5008-4b48-8d78-55965eba405c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.578874 Aug 30 04:30:18.096357 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 44/93] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:17 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:18.279036 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:18.280240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:18.294907 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.296059 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.297529 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.300088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.301277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.302429 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.320760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-5bc9d3db-53aa-4ccf-864f-ea3b38ab2946 req-c297a913-7f99-4f67-a8b9-b8da08b212c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a566046-e7ae-47bc-bba8-3875c0ef4fa9", "tag": "a074f768-02bd-44f4-a577-4d4aee4c169b"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:18.342551 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5bc9d3db-53aa-4ccf-864f-ea3b38ab2946 req-c297a913-7f99-4f67-a8b9-b8da08b212c8 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.345883 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5bc9d3db-53aa-4ccf-864f-ea3b38ab2946 req-c297a913-7f99-4f67-a8b9-b8da08b212c8 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.346602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5bc9d3db-53aa-4ccf-864f-ea3b38ab2946 req-c297a913-7f99-4f67-a8b9-b8da08b212c8 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.374375 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-5bc9d3db-53aa-4ccf-864f-ea3b38ab2946 req-c297a913-7f99-4f67-a8b9-b8da08b212c8 service nova] Creating event network-changed:a074f768-02bd-44f4-a577-4d4aee4c169b for instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 on hv-cinder-85426 Aug 30 04:30:18.386334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-5bc9d3db-53aa-4ccf-864f-ea3b38ab2946 req-c297a913-7f99-4f67-a8b9-b8da08b212c8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071480 Aug 30 04:30:18.387602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 45/94] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:18.667684 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7dae576-7350-470c-9d21-64f1b5ccb0a3"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:18.671035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:18.682206 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.683052 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.683757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.684706 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.685301 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.685776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.804212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.831553 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.836933 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.840927 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2c6253d8-b11e-4f3c-aa1c-4e99e6f9b06f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.568208 Aug 30 04:30:18.843047 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 50/95] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:18 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:18.985197 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:18.986317 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:19.000256 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.001749 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.002896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.005329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.006612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.009013 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.397644 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.416866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ac86b455-30e3-442f-befc-53efd6916560 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.441092 Aug 30 04:30:19.418872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 51/96] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:18 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:19.438203 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:19.439509 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:19.447720 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.448429 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.449076 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.450109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.450705 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.451241 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.903838 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.925347 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b506f44e-c4e6-4d1f-886b-4dbb06d91228 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.499185 Aug 30 04:30:19.926926 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 52/97] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:19 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:19.936724 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-9a2bc5be-dc89-4aca-95b6-68fb69c68444 req-029f0347-0677-42fe-b885-3294ea1da17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beaafec3-5f47-4d5f-bc1c-76a9d298c6f0", "name": "network-vif-plugged", "status": "completed", "tag": "6ba6f446-03eb-4bc2-b1f9-d5d271187715"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:19.968632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-9a2bc5be-dc89-4aca-95b6-68fb69c68444 req-029f0347-0677-42fe-b885-3294ea1da17e service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.969777 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-9a2bc5be-dc89-4aca-95b6-68fb69c68444 req-029f0347-0677-42fe-b885-3294ea1da17e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.970696 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-9a2bc5be-dc89-4aca-95b6-68fb69c68444 req-029f0347-0677-42fe-b885-3294ea1da17e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.996565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-9a2bc5be-dc89-4aca-95b6-68fb69c68444 req-029f0347-0677-42fe-b885-3294ea1da17e service nova] Creating event network-vif-plugged:6ba6f446-03eb-4bc2-b1f9-d5d271187715 for instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 on hv-cinder-85426 Aug 30 04:30:20.014729 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-9a2bc5be-dc89-4aca-95b6-68fb69c68444 req-029f0347-0677-42fe-b885-3294ea1da17e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085194 Aug 30 04:30:20.015347 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 53/98] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:20.028523 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:20.029245 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:20.037306 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.038192 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.038822 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.040758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.041461 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.042090 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.122841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c0518929-346c-4305-b749-93af563e6186 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "POST /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.460699 Aug 30 04:30:20.125457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 46/99] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:30:18 2022] POST /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31/os-volume_attachments => generated 194 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:20.458621 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:20.460246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:20.478693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.481939 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.483593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.484621 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.487972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.488734 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.509334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:20.557696 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.579243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.584700 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.587791 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a70c0bf7-1f9c-4782-837f-030e1daf807e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.570895 Aug 30 04:30:20.589155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 54/100] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:20 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:20.761565 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.770456 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9794edff-839f-4024-9200-86329ab7bbf7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.319993 Aug 30 04:30:20.771734 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 47/101] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:20 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:20.967659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:20.967659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:20.976082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.977112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.978668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.980515 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.981874 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.983046 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.320477 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:21.335934 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e3b7c834-9588-4aef-9e02-a208567f44b5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.391939 Aug 30 04:30:21.370552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 55/102] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:20 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:21.642815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:21.643691 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:21.657027 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.657526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.658092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.658656 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.659107 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.659519 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.799795 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:21.802604 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:21.809601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=89 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:21.823161 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.824746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.826030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.827875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.829140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.832269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.017706 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.036982 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.042665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.045943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ac3c7540-e495-4317-805f-87b38dfcd6ff tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.407265 Aug 30 04:30:22.051657 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 48/103] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:21 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:22.238796 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.260112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8cab9cf1-1a78-4926-96d5-036f483f195b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.468573 Aug 30 04:30:22.278079 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 56/104] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:21 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:22.362533 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:22.364577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:22.371354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.372094 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:22.372628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.373423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.374408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:22.375332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.645113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.654512 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ec783e32-8898-4e7f-8041-a7f4ca01e783 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1321 microversion: 2.1 time: 0.298759 Aug 30 04:30:22.655982 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 49/105] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:22 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:23.092752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:23.094109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:23.107161 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.110793 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.117728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.120327 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.124763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.125555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.297921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:23.298992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:23.312271 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.313128 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.313899 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.321489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.322734 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.324239 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.628265 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:23.663592 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:23.669140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:23.674813 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cd5b21d6-890b-4212-8881-6b9b91935c22 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.585639 Aug 30 04:30:23.689825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 57/106] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:23 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:23.710346 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1968494409", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:23.902701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:23.914023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] validate_networks() for None {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:30:23.951597 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-96114884-38b0-49cc-aace-b458ee562495 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.657783 Aug 30 04:30:23.953094 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 50/107] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:23 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:23.962916 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-7ae1c0bf-e67c-4d85-8cb9-c55f26c70238 req-01363ef2-5ea0-43e9-bedc-a0e0ae03780a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "name": "network-vif-plugged", "status": "completed", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:23.985922 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:23.991383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7ae1c0bf-e67c-4d85-8cb9-c55f26c70238 req-01363ef2-5ea0-43e9-bedc-a0e0ae03780a service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.992684 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7ae1c0bf-e67c-4d85-8cb9-c55f26c70238 req-01363ef2-5ea0-43e9-bedc-a0e0ae03780a service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.993762 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7ae1c0bf-e67c-4d85-8cb9-c55f26c70238 req-01363ef2-5ea0-43e9-bedc-a0e0ae03780a service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.017456 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-7ae1c0bf-e67c-4d85-8cb9-c55f26c70238 req-01363ef2-5ea0-43e9-bedc-a0e0ae03780a service nova] Creating event network-vif-plugged:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:30:24.023424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-7ae1c0bf-e67c-4d85-8cb9-c55f26c70238 req-01363ef2-5ea0-43e9-bedc-a0e0ae03780a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068221 Aug 30 04:30:24.024954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 51/108] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:24.034109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.035332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.053229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.054041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.054916 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.056236 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.057217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.058282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.274635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.291182 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ab8c6427-a47c-400d-a1af-80b985ed59b1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1514 microversion: 2.1 time: 0.263421 Aug 30 04:30:24.300066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 52/109] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:24 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:24.323964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:24.327347 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.338928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.339275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.340015 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.341202 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.341960 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.342674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.401278 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'flavor' on Instance uuid beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:30:24.474028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:24.475086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:24.475723 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:24.477486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:24.478074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:24.498245 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.499112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.500216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.501413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.502970 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.504061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.538654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Getting quotas for project 92b93bd6951d461ba2f6586f3566699d. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:24.547429 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Getting quotas for user 0ad11e9c9afd47f2833edac5f0b83c61 and project 92b93bd6951d461ba2f6586f3566699d. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:24.583337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:24.588427 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:24.692157 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-10db63fd-679a-4ab9-a4d2-24d14c3e5a46 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996296 Aug 30 04:30:24.693841 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 58/110] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:30:24.716737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-77e0f009-d751-4bff-ab0a-dcc530b03e05 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0/action" status: 200 len: 32 microversion: 2.1 time: 0.398890 Aug 30 04:30:24.718200 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 53/111] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:30:24 2022] POST /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:30:24.719335 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-15ad0bd0-363b-4947-9650-ce72d96fd104 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.720917 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-15ad0bd0-363b-4947-9650-ce72d96fd104 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.727737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.728446 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.749120 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.750111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.750869 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.752170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.753298 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.754087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.858574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-15ad0bd0-363b-4947-9650-ce72d96fd104 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.870767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-15ad0bd0-363b-4947-9650-ce72d96fd104 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1215 microversion: 2.1 time: 0.164938 Aug 30 04:30:24.884004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 59/112] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:24 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:24.896510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.898297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.927855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.929464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.934021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.935729 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.937630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.938414 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.490977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.523236 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.531795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.533170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-54bad069-829f-4b23-91af-6983268acfb3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.813644 Aug 30 04:30:25.553958 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 54/113] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:24 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:25.553958 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:25.553958 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:25.568054 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.568978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.569823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.571339 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.572218 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.573066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.909228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.924831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a28e1619-6d0a-49f9-9bd8-fcf0f6c88b69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 1.051793 Aug 30 04:30:25.925714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 60/114] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:24 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:25.932702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:25.933968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:25.955606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.956393 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.956579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.957816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.959141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.960008 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.961219 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.974988 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a5c4f78d-1382-4edd-8253-11c341a2a6b6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.439078 Aug 30 04:30:25.976584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 55/115] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:25 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:25.991183 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:25.998468 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:26.014636 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.015131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.015766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.016788 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.017757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.018336 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.055829 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:30:26.133235 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.147416 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4b68fe73-e50a-4314-82c1-6efd30558c93 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1219 microversion: 2.1 time: 0.167944 Aug 30 04:30:26.164889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 56/116] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:25 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:26.412410 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-45ad71c7-b14a-4a46-b7f0-a50b78ec47ec tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 204 len: 0 microversion: 2.1 time: 0.482343 Aug 30 04:30:26.413129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 61/117] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:30:25 2022] DELETE /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:30:26.426784 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:26.427875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:26.451799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.459757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.464220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.466277 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.470917 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.471862 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.578130 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:26.578886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:26.593555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.594089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.594542 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.595333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.595875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.596336 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.873943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.885702 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5163e7c8-5914-441c-be68-09b03a3c9542 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1555 microversion: 2.1 time: 0.466220 Aug 30 04:30:26.886845 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 57/118] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:26 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1555 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:26.966688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:26.967767 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:26.973585 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.977095 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.978269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.979337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.980324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.981111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.982291 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.985555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.987864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.991866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-25dbc493-c43c-43c0-8a50-25e10105b4c9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.418868 Aug 30 04:30:26.992886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 62/119] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:26 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:27.026740 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:27.027526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:27.035504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.037818 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.038495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.040081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.040732 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.041419 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.266567 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.285969 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-232affbf-e18d-4655-a6b8-870d68b15c69 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.325886 Aug 30 04:30:27.294091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 58/120] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:26 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:27.307980 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:27.310237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:27.328015 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.331223 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.332692 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.334589 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.338448 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.339654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.341097 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.344004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c151c628-d901-47f1-84a6-1f6b73ddcaff tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.321984 Aug 30 04:30:27.344832 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 63/121] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:27 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:27.468015 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.479480 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-de9608da-2ea0-4061-ada2-83dddefc3771 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1211 microversion: 2.1 time: 0.183621 Aug 30 04:30:27.480230 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 59/122] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:27 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1211 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:27.930287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:27.931348 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:27.951189 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.952919 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.953435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.954163 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.954638 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.955064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.034608 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:28.035833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:28.050617 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.051118 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.051568 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.052340 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.053024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.053275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.332513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.360074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-be67d54e-14a2-433f-960c-b94942b15a48 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1555 microversion: 2.1 time: 0.429023 Aug 30 04:30:28.360074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 64/123] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:27 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1555 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:28.374321 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-0914748f-6f1a-4c24-8553-83055ecfcec8 req-2d10eed4-de19-46fe-a6cc-63774ee78bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a566046-e7ae-47bc-bba8-3875c0ef4fa9", "name": "network-vif-plugged", "status": "completed", "tag": "a074f768-02bd-44f4-a577-4d4aee4c169b"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:28.394540 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-0914748f-6f1a-4c24-8553-83055ecfcec8 req-2d10eed4-de19-46fe-a6cc-63774ee78bef service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.396911 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-0914748f-6f1a-4c24-8553-83055ecfcec8 req-2d10eed4-de19-46fe-a6cc-63774ee78bef service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.397828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-0914748f-6f1a-4c24-8553-83055ecfcec8 req-2d10eed4-de19-46fe-a6cc-63774ee78bef service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.403465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.417698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.419365 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.421614 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-60341bbd-314f-471c-8cd8-f9ebffc8435b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1407 microversion: 2.20 time: 0.408008 Aug 30 04:30:28.422973 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 60/124] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:28 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:28.432399 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:28.433194 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:28.433997 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-0914748f-6f1a-4c24-8553-83055ecfcec8 req-2d10eed4-de19-46fe-a6cc-63774ee78bef service nova] Creating event network-vif-plugged:a074f768-02bd-44f4-a577-4d4aee4c169b for instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 on hv-cinder-85426 Aug 30 04:30:28.444340 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-0914748f-6f1a-4c24-8553-83055ecfcec8 req-2d10eed4-de19-46fe-a6cc-63774ee78bef service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089874 Aug 30 04:30:28.444643 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.444907 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.445041 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 65/125] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:28.445626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.446690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.447409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.448232 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.453404 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:28.455011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:28.463272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.466984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.466984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.466984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.466984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.467581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.727634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.752279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4a465444-3b7f-4879-b56a-aa59a364e079 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.305741 Aug 30 04:30:28.753363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 66/126] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:28 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:28.761542 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:28.762324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:28.775207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.775888 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.777142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.778931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.780563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.781174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.792271 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.815604 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7848ff70-9dd0-427f-b679-66b18c1e2505 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.391122 Aug 30 04:30:28.817258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 61/127] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:28 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:28.820688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:28.897158 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.909544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d9951909-44f5-4528-985b-e61f0db554a7 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1211 microversion: 2.1 time: 0.154598 Aug 30 04:30:28.910703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 67/128] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:28 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1211 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:29.384946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:29.386966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:29.395573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.396570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.397484 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.398572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.399383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.399786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.425697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:29.474135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:29.474981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:29.494060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.494547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.494975 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.495692 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.496167 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.496576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.649947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.665714 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d4e9e39b-94e0-4d2b-8ab0-4289e2389022 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1555 microversion: 2.1 time: 0.287566 Aug 30 04:30:29.667058 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 62/129] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:29 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:29.695440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.719038 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.721609 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.724249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-000a3b5e-f4e0-438d-bf8c-1862f70ad3ae tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1599 microversion: 2.20 time: 0.254532 Aug 30 04:30:29.725526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 68/130] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:29 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1599 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:29.758695 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:29.763258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:29.774787 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.775630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.776333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.777846 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.779097 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.780109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.818951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:29.821652 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:29.858240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.859777 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.867055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.869675 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.870783 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.872629 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.076717 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5b7407ac-5aa6-4a17-8343-e6bd0d5671ac tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.326958 Aug 30 04:30:30.078529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 63/131] 10.222.0.91 () {60 vars in 1316 bytes} [Tue Aug 30 04:30:29 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:30:30.108878 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:30.111003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:30.147758 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.149100 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.150123 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.152501 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.159654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.160779 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.626649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:30.640240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a2197b99-4278-46ca-a2db-3bb0e1b46e8d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.834522 Aug 30 04:30:30.642476 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 69/132] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:29 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:30.657555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:30.658795 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:30.679979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.680847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.681609 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.682866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.683551 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.696969 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.882271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:30.895241 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c29baa9f-a490-42db-a789-e3b6577150f3 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1267 microversion: 2.1 time: 0.247988 Aug 30 04:30:30.896547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 70/133] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:30 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:30.903323 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:30.904513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:30.916810 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.917861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.919559 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.920787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.921843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.923587 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.462592 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:31.487515 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-571e638f-cd20-40ec-bcbb-824a8e6af43e tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1555 microversion: 2.1 time: 0.589138 Aug 30 04:30:31.489549 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 71/134] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:30 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1555 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:31.683036 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:31.683875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:31.697929 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.698734 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.699516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.701010 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.701921 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.702662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.858157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:31.875860 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e566eb08-4ffb-4b94-84ef-ea2632199a2b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 1.795103 Aug 30 04:30:31.888335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 64/135] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:30 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:31.921284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:31.922404 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:31.947001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.953143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.954150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.955837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.960594 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.961797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.081207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.091971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e95fab17-55e9-4e09-81a2-708f31005b10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.416470 Aug 30 04:30:32.092746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 72/136] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:31 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:32.101650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-fefc6c0b-9b96-4f7e-a760-a21096a62842 req-a6c5398d-e76f-4bb6-b407-f544f1a817f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ad200a-0b2a-4bf1-8d08-2e48447b0c31", "name": "network-vif-deleted", "tag": "17d9b26c-46af-4399-b1cd-5ae925d73d03"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:32.119730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-fefc6c0b-9b96-4f7e-a760-a21096a62842 req-a6c5398d-e76f-4bb6-b407-f544f1a817f1 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.120605 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-fefc6c0b-9b96-4f7e-a760-a21096a62842 req-a6c5398d-e76f-4bb6-b407-f544f1a817f1 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.121377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-fefc6c0b-9b96-4f7e-a760-a21096a62842 req-a6c5398d-e76f-4bb6-b407-f544f1a817f1 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.135197 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-fefc6c0b-9b96-4f7e-a760-a21096a62842 req-a6c5398d-e76f-4bb6-b407-f544f1a817f1 service nova] Creating event network-vif-deleted:17d9b26c-46af-4399-b1cd-5ae925d73d03 for instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 on hv-cinder-85426 Aug 30 04:30:32.140889 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-fefc6c0b-9b96-4f7e-a760-a21096a62842 req-a6c5398d-e76f-4bb6-b407-f544f1a817f1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046504 Aug 30 04:30:32.141508 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 73/137] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:32.201231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.214298 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a9ffbd4b-dd71-4804-a253-74f0fa79b9fb tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1273 microversion: 2.1 time: 0.300021 Aug 30 04:30:32.217408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 65/138] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:31 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:32.532430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:32.533559 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:32.543583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.544486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.546037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.551123 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.552377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.553382 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.716616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.733536 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5e9f299a-654c-430f-869b-928b817cfc9f tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1346 microversion: 2.1 time: 0.208489 Aug 30 04:30:32.735080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 74/139] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:32 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:32.913485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:32.915701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:32.946591 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.947969 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.950029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.954666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.955684 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.959776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.139819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:33.146409 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:33.161071 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.162881 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.164155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.176029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.177331 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.178314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.473695 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.485530 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1447e395-8f1d-4295-b4fc-f030640f53a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1363 microversion: 2.1 time: 0.357839 Aug 30 04:30:33.487440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 75/140] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:33 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:33.494782 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:33.495604 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:33.502725 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.503406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.504212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.505307 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.505892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.515838 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.591070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.595067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.607068 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6859b076-2cd0-4588-9ee0-0f107e0507ab tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1273 microversion: 2.1 time: 0.117753 Aug 30 04:30:33.620749 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 76/141] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:33 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:33.621168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0a015cf3-7053-4071-9470-56bb47743b30 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.703914 Aug 30 04:30:33.621168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 66/142] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:32 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:33.773888 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:33.775389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:33.792097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.794625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.795315 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.797047 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.799351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.800538 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.865030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.865874 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.866896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.869430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lazy-loading 'fault' on Instance uuid f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:30:33.956380 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364abb1a054f45c3b95ac2f5714763a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8ee9d47bc94efca1f8c216349b0809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.982021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fd1814c9-31d7-4867-baad-611879544e47 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 200 len: 1351 microversion: 2.1 time: 0.214749 Aug 30 04:30:33.991318 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 77/143] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:33 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 1351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:34.524116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:34.525548 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:34.533434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.534454 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.535218 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.537143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.538764 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.539464 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.579062 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-8df9b79c-41d2-4ed1-8e94-ae3145e540ba req-f580c0c7-e5ce-4b0d-95e2-0de5fe0fd274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:34.601020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:34.655407 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8df9b79c-41d2-4ed1-8e94-ae3145e540ba req-f580c0c7-e5ce-4b0d-95e2-0de5fe0fd274 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.655979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8df9b79c-41d2-4ed1-8e94-ae3145e540ba req-f580c0c7-e5ce-4b0d-95e2-0de5fe0fd274 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.657857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8df9b79c-41d2-4ed1-8e94-ae3145e540ba req-f580c0c7-e5ce-4b0d-95e2-0de5fe0fd274 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.686702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-8df9b79c-41d2-4ed1-8e94-ae3145e540ba req-f580c0c7-e5ce-4b0d-95e2-0de5fe0fd274 service nova] Creating event network-changed:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:30:34.703136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-8df9b79c-41d2-4ed1-8e94-ae3145e540ba req-f580c0c7-e5ce-4b0d-95e2-0de5fe0fd274 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131821 Aug 30 04:30:34.704837 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 78/144] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:34.714646 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:34.716503 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:34.728251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.729098 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.729632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.731408 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.732045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.732719 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.812857 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:34.838652 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1a37fa72-dd36-43d9-a4a5-9573037a05a4 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1548 microversion: 2.1 time: 0.320356 Aug 30 04:30:34.853362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 67/145] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:34 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1548 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:34.870142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=8 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:34.878891 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:34.879671 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:34.910902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.913035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.913814 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.917663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.920487 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.921224 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.236236 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:35.247413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fa099dc4-31aa-4850-9184-b19c34039456 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.540632 Aug 30 04:30:35.248754 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 79/146] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:34 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:35.255233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:35.256179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:35.264189 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.264915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.265684 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.266765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.267406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.268455 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.642924 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:35.657133 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-75756809-ffae-4881-99b7-670470f70529 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.802183 Aug 30 04:30:35.658705 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 68/147] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:34 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:35.673288 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:35.675473 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:35.693529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.694732 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.696925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.698831 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.700995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.702576 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.735880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] HTTP exception thrown: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Request method failure captured: Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 HTTP/1.1 Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZIhNo9ABv_xfYz5AIoXxjrRdtDvl55_p3MgvAJRnBdM7TeXCkj4wSCh37aBdDbSTgYYy32u4QScgOt_OctkQCsfYk6N6zoX8-xG5MsxffpqNvGaoKs-gp9PWWlg3u-6eaQYoaEdz-8dY5QbsTt8aSf0R9_P909YrdbWU3g09qI8l3g Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:30:35.781496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 364abb1a054f45c3b95ac2f5714763a0 Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:35.782863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'f4ad200a-0b2a-4bf1-8d08-2e48447b0c31'} Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:35.783588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:35.784744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:35.788791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Returning 404 to user: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:35.788791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6295929f-b248-49e1-8263-716dae5dbbf9 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 404 len: 111 microversion: 2.1 time: 0.120568 Aug 30 04:30:35.788791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 69/148] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:35 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:35.805537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1b6c764e-f5e7-49f0-80c7-d651629fe173 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.555007 Aug 30 04:30:35.806577 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 80/149] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:30:35 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-interface => generated 284 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:36.037019 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:36.044980 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:36.060496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.061910 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.062847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.063830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.065321 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.067176 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.087668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] HTTP exception thrown: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Request method failure captured: Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31/os-volume_attachments HTTP/1.1 Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZIhNo9ABv_xfYz5AIoXxjrRdtDvl55_p3MgvAJRnBdM7TeXCkj4wSCh37aBdDbSTgYYy32u4QScgOt_OctkQCsfYk6N6zoX8-xG5MsxffpqNvGaoKs-gp9PWWlg3u-6eaQYoaEdz-8dY5QbsTt8aSf0R9_P909YrdbWU3g09qI8l3g Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:30:36.090136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 364abb1a054f45c3b95ac2f5714763a0 Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:36.091355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'server_id': 'f4ad200a-0b2a-4bf1-8d08-2e48447b0c31'} Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:36.092070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:36.093140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.097849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Returning 404 to user: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:36.098657 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f9a7f99a-75f0-40dc-af72-8f66269d2653 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073165 Aug 30 04:30:36.099665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 70/150] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:36 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31/os-volume_attachments => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:36.286783 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:36.288258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:36.301077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.301995 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.304014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.304959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.309262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.309953 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.686111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:36.686976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:36.697660 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.708081 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.708912 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.709887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.710361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.710787 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.323547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.336684 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f87286d5-01e5-48b9-95cc-4bf15f15e1a2 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 1.054290 Aug 30 04:30:37.338730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 81/151] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:36 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:37.515023 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.537862 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4ff673ad-826c-4783-8395-7852aa406f3a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.852655 Aug 30 04:30:37.541807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 71/152] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:36 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:37.553704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.554356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:37.566019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.566975 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.567751 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.572949 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.573814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.575135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.618533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] HTTP exception thrown: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Request method failure captured: Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 HTTP/1.1 Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZIhNo9ABv_xfYz5AIoXxjrRdtDvl55_p3MgvAJRnBdM7TeXCkj4wSCh37aBdDbSTgYYy32u4QScgOt_OctkQCsfYk6N6zoX8-xG5MsxffpqNvGaoKs-gp9PWWlg3u-6eaQYoaEdz-8dY5QbsTt8aSf0R9_P909YrdbWU3g09qI8l3g Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:30:37.628440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 364abb1a054f45c3b95ac2f5714763a0 Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.630330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'f4ad200a-0b2a-4bf1-8d08-2e48447b0c31'} Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:37.631018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.633287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.641631 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Returning 404 to user: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:37.641631 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fd6f2c26-e74d-409b-96c0-af2bb7d8ec16 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 404 len: 111 microversion: 2.1 time: 0.089456 Aug 30 04:30:37.644170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 82/153] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:30:37 2022] DELETE /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:37.651974 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.652963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] [instance: f4ad200a-0b2a-4bf1-8d08-2e48447b0c31] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:37.667451 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.672311 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.672952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.675249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.678685 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.681164 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.721767 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] HTTP exception thrown: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Request method failure captured: Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 HTTP/1.1 Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZIhNo9ABv_xfYz5AIoXxjrRdtDvl55_p3MgvAJRnBdM7TeXCkj4wSCh37aBdDbSTgYYy32u4QScgOt_OctkQCsfYk6N6zoX8-xG5MsxffpqNvGaoKs-gp9PWWlg3u-6eaQYoaEdz-8dY5QbsTt8aSf0R9_P909YrdbWU3g09qI8l3g Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:30:37.727739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0a8ee9d47bc94efca1f8c216349b0809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 0a8ee9d47bc94efca1f8c216349b0809 Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-DeleteServersTestJSON-870960113 Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 364abb1a054f45c3b95ac2f5714763a0 Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-DeleteServersTestJSON-870960113-project Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.729028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'f4ad200a-0b2a-4bf1-8d08-2e48447b0c31'} Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:37.729849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. Aug 30 04:30:37.731760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:37.734499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] Returning 404 to user: Instance f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:37.741148 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c23de68a-197c-45e7-aa99-5573d89ec590 tempest-DeleteServersTestJSON-870960113 tempest-DeleteServersTestJSON-870960113-project] 10.222.0.91 "GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31" status: 404 len: 111 microversion: 2.1 time: 0.092688 Aug 30 04:30:37.742125 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 72/154] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:37 2022] GET /compute/v2.1/servers/f4ad200a-0b2a-4bf1-8d08-2e48447b0c31 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:38.362251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:38.370385 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:38.387574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.388373 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.389001 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.390240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.390955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.391547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.447712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-aac3b016-8e04-4abc-8e08-bd804d41d0f2 req-d78f9dc0-e0f8-4ea0-9ef6-2333a5d77cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "859b50bf-b0cd-454b-8109-baf01c345feb", "tag": "07a57c21-c2d8-4415-a529-3b656d7dda64"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:38.469284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-aac3b016-8e04-4abc-8e08-bd804d41d0f2 req-d78f9dc0-e0f8-4ea0-9ef6-2333a5d77cfd service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.471979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-aac3b016-8e04-4abc-8e08-bd804d41d0f2 req-d78f9dc0-e0f8-4ea0-9ef6-2333a5d77cfd service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.472833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-aac3b016-8e04-4abc-8e08-bd804d41d0f2 req-d78f9dc0-e0f8-4ea0-9ef6-2333a5d77cfd service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.502653 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-aac3b016-8e04-4abc-8e08-bd804d41d0f2 req-d78f9dc0-e0f8-4ea0-9ef6-2333a5d77cfd service nova] Creating event network-changed:07a57c21-c2d8-4415-a529-3b656d7dda64 for instance 859b50bf-b0cd-454b-8109-baf01c345feb on hv-cinder-85426 Aug 30 04:30:38.521912 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-aac3b016-8e04-4abc-8e08-bd804d41d0f2 req-d78f9dc0-e0f8-4ea0-9ef6-2333a5d77cfd service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078254 Aug 30 04:30:38.523146 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 73/155] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:38.578531 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:38.582453 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:38.600833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.601618 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.602196 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.603062 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.603648 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.604257 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:39.082926 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:39.111418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bc8bc7d4-a9ac-445e-8d5c-a9be8418f314 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.753475 Aug 30 04:30:39.113667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 83/156] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:38 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:39.504699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:39.523090 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-593b78e0-dc96-49bc-8b88-f9a7737f8841 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.940601 Aug 30 04:30:39.524653 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 74/157] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:38 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:40.156667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:40.159147 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:40.182387 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.185028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.188273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.190032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.192201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.193497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.567978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:40.569774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:40.588549 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.591266 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.593143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.604590 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.606462 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.610766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.765251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:40.793213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d551f027-1f73-477c-9251-1ef1eb54cae1 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.637338 Aug 30 04:30:40.802322 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 84/158] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:40 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:40.868947 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-a697f87e-781c-4f57-bb93-11eb58fdc1f0 req-21b9b60a-bb5a-426c-afd2-ec0b617f90af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a566046-e7ae-47bc-bba8-3875c0ef4fa9", "tag": "a074f768-02bd-44f4-a577-4d4aee4c169b"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:40.951626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-a697f87e-781c-4f57-bb93-11eb58fdc1f0 req-21b9b60a-bb5a-426c-afd2-ec0b617f90af service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.955374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-a697f87e-781c-4f57-bb93-11eb58fdc1f0 req-21b9b60a-bb5a-426c-afd2-ec0b617f90af service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.957232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-a697f87e-781c-4f57-bb93-11eb58fdc1f0 req-21b9b60a-bb5a-426c-afd2-ec0b617f90af service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:41.027513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-a697f87e-781c-4f57-bb93-11eb58fdc1f0 req-21b9b60a-bb5a-426c-afd2-ec0b617f90af service nova] Creating event network-changed:a074f768-02bd-44f4-a577-4d4aee4c169b for instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 on hv-cinder-85426 Aug 30 04:30:41.038543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-a697f87e-781c-4f57-bb93-11eb58fdc1f0 req-21b9b60a-bb5a-426c-afd2-ec0b617f90af service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204546 Aug 30 04:30:41.039695 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 85/159] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:41.290284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:41.317863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b42a3207-d231-415c-9858-13f85119caeb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.751840 Aug 30 04:30:41.321886 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 75/160] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:40 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:41.857835 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:41.861497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:41.874596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:41.881727 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:41.882473 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:41.883479 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:41.884151 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:41.884768 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:41.954651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=100 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:42.241810 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:42.253693 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8f875c6d-782e-42f7-940e-77486d14adda tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.406310 Aug 30 04:30:42.271090 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 86/161] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:41 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:42.372691 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:42.373522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:42.392824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.393376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.393821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.394744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.428508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.429273 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.278077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:43.279543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:43.294540 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.295751 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.300702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.305882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.308365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.308854 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.665582 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.675900 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-82852f98-42bb-44d3-8726-233f5edefcb5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 1.322548 Aug 30 04:30:43.677258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 76/162] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:42 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:43.978623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.993516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3f94b79b-b721-4f54-8baa-ad8a95d5c41c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.719615 Aug 30 04:30:44.011789 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 87/163] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:43 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:44.705275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:44.714306 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:44.735343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.736178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.736926 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:44.738229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.744294 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.745179 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.032582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:45.037481 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:45.077297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.080465 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.085870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.091111 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.091651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.100347 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.432132 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:45.446688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7311766a-dc1e-4ab7-a219-78862ff03533 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.425828 Aug 30 04:30:45.450253 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 88/164] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:45 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:45.501908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:45.529696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1ce493df-e2cd-4272-b643-28941311406b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.833724 Aug 30 04:30:45.536841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 77/165] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:44 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:46.441071 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-b5c1c0fe-0274-4c4b-851c-97070ec5aafb req-e77a11a0-026f-4e1b-8934-1a2611b6ef1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859b50bf-b0cd-454b-8109-baf01c345feb", "name": "network-vif-plugged", "status": "completed", "tag": "07a57c21-c2d8-4415-a529-3b656d7dda64"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:46.484294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b5c1c0fe-0274-4c4b-851c-97070ec5aafb req-e77a11a0-026f-4e1b-8934-1a2611b6ef1d service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.497448 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:46.501553 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:46.501890 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b5c1c0fe-0274-4c4b-851c-97070ec5aafb req-e77a11a0-026f-4e1b-8934-1a2611b6ef1d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.502308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b5c1c0fe-0274-4c4b-851c-97070ec5aafb req-e77a11a0-026f-4e1b-8934-1a2611b6ef1d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.536167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.541671 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-b5c1c0fe-0274-4c4b-851c-97070ec5aafb req-e77a11a0-026f-4e1b-8934-1a2611b6ef1d service nova] Creating event network-vif-plugged:07a57c21-c2d8-4415-a529-3b656d7dda64 for instance 859b50bf-b0cd-454b-8109-baf01c345feb on hv-cinder-85426 Aug 30 04:30:46.548552 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.554126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.562178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.563573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.569840 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-b5c1c0fe-0274-4c4b-851c-97070ec5aafb req-e77a11a0-026f-4e1b-8934-1a2611b6ef1d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132698 Aug 30 04:30:46.570954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.575623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 89/166] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:46.595829 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:46.601999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:46.618251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.619141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.619782 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.620749 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.621430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.622077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.143345 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.152688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.182250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-665abb3a-c1c3-4810-8e0c-735c39d373b8 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.694046 Aug 30 04:30:47.184178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 78/167] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:46 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:47.186196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3c45f143-baa4-4203-a793-23033adf9097 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.606041 Aug 30 04:30:47.187813 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 90/168] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:46 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:48.207101 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:48.207799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:48.221866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:48.222752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:48.235004 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.242348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.242798 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.245901 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.248343 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.248957 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.249379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.250122 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.257155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.259903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.265832 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.267464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.681692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.693220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cd9efa0b-2ba9-41cb-9b3f-53e0529cf898 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1315 microversion: 2.1 time: 0.490435 Aug 30 04:30:48.693823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 79/169] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:48 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:48.718093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.744930 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b6f146ca-d9e0-4e51-8041-3059c4bd6e06 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.526728 Aug 30 04:30:48.745986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 91/170] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:48 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:49.737548 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:49.738826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:49.749450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.749948 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.750376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.751419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.752078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.752695 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.791613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:49.792332 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:49.806983 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.808043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.808754 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.809796 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.810447 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.811682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.014342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.029397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-83dffde2-69e2-435b-b465-187059fa5fcd tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1464 microversion: 2.1 time: 0.302013 Aug 30 04:30:50.030547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 80/171] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:49 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1464 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:50.080155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.081050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:50.088347 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.089423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.090680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.092145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.092938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.093864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.108073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.127297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-83896d31-7b28-4954-9c84-addfd65d0314 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.342499 Aug 30 04:30:50.132713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:30:50.142812 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 92/172] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:49 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:50.168989 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:50.296998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-69d46730-02d2-4461-8e47-5327c105176d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "DELETE /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 204 len: 0 microversion: 2.1 time: 0.220354 Aug 30 04:30:50.298730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 81/173] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:30:50 2022] DELETE /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:30:50.313865 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.315378 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:50.325470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.326359 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.327059 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.327850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.328329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.328914 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.573231 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.594429 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a1e602e8-dd51-44dd-a6ae-e7e86491e3ce tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1470 microversion: 2.1 time: 0.286528 Aug 30 04:30:50.595345 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 93/174] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:50 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:51.024305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2025641188", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "networks": [{"uuid": "aea69756-e786-4cf8-8d76-5170bbdf521b"}]}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:51.136998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] validate_networks() for [('aea69756-e786-4cf8-8d76-5170bbdf521b', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:30:51.156164 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:51.157178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:51.201678 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:51.206102 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.207173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.207831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.209397 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.212460 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.213654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.549102 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:51.568797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ce56361d-9c15-4aff-92f5-8eb2e4985c46 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.418752 Aug 30 04:30:51.570425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 94/175] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:51 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:51.622246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:51.623308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:51.631421 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.632453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.633049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.633952 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.634586 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.637144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.859704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:51.872842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b4486934-9aab-40c0-b949-0db27b1d8d97 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1470 microversion: 2.1 time: 0.254895 Aug 30 04:30:51.888147 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 95/176] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:51 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:51.893023 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:51.893429 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:51.893994 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:51.894759 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:51.895295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:51.907496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.908076 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.908514 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.909376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.910546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.911047 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.933377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Getting quotas for project 9322fbe1939b46c3aee2418884f81e9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:51.944674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Getting quotas for user f237249974584d938baf71727ea3a162 and project 9322fbe1939b46c3aee2418884f81e9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:51.965243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:51.968592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:52.042272 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-146d02f1-25ac-4219-88fa-c8b27965559f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026668 Aug 30 04:30:52.043894 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 82/177] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:30:52.059965 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7375bf12-64ad-49bb-9fee-46a46392fdf8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:52.067009 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7375bf12-64ad-49bb-9fee-46a46392fdf8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:52.197567 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7375bf12-64ad-49bb-9fee-46a46392fdf8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:52.213875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7375bf12-64ad-49bb-9fee-46a46392fdf8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1219 microversion: 2.1 time: 0.159956 Aug 30 04:30:52.215410 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 96/178] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:52 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:52.591994 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:52.593123 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:52.608926 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.609704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.610130 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.611796 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.612959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.616780 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.918433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:52.920255 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:52.939083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.940135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.941076 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.943005 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.944178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.945244 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.091493 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.110511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-aa4f0299-3c77-437d-8210-98e37a68616d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.522692 Aug 30 04:30:53.111375 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 83/179] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:52 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:53.234919 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:53.235567 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:53.242686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.249471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.249966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.250401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.251115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.251569 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.254174 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.256068 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4e37a78c-7296-4061-a75a-613b2de7ae1c tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1470 microversion: 2.1 time: 0.348032 Aug 30 04:30:53.257205 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 97/180] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:52 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:53.404652 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.418384 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fbe14f5b-198e-4b29-89fb-5c87d8a37b1f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1215 microversion: 2.1 time: 0.185968 Aug 30 04:30:53.420152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 84/181] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:53 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:53.881142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-7f995f72-e3c9-4671-8c8f-fba7a43c0b6c req-fccc0aee-ed6a-4792-a0b4-f889022e2b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859b50bf-b0cd-454b-8109-baf01c345feb", "name": "network-vif-deleted", "tag": "07a57c21-c2d8-4415-a529-3b656d7dda64"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:53.917303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-7f995f72-e3c9-4671-8c8f-fba7a43c0b6c req-fccc0aee-ed6a-4792-a0b4-f889022e2b67 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.920307 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-7f995f72-e3c9-4671-8c8f-fba7a43c0b6c req-fccc0aee-ed6a-4792-a0b4-f889022e2b67 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.921011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-7f995f72-e3c9-4671-8c8f-fba7a43c0b6c req-fccc0aee-ed6a-4792-a0b4-f889022e2b67 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.964972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-7f995f72-e3c9-4671-8c8f-fba7a43c0b6c req-fccc0aee-ed6a-4792-a0b4-f889022e2b67 service nova] Creating event network-vif-deleted:07a57c21-c2d8-4415-a529-3b656d7dda64 for instance 859b50bf-b0cd-454b-8109-baf01c345feb on hv-cinder-85426 Aug 30 04:30:53.979400 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-7f995f72-e3c9-4671-8c8f-fba7a43c0b6c req-fccc0aee-ed6a-4792-a0b4-f889022e2b67 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103325 Aug 30 04:30:53.982438 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 98/182] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:54.143054 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:54.145806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.178328 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:54.203889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.204434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.206272 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.213229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.213674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.220952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.282454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:54.283150 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.293904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.294406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.294845 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.304554 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.313343 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.314840 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.749783 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.770396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0549895f-11bd-4a15-818e-80cfee852c1d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.634930 Aug 30 04:30:54.774334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 85/183] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:54 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:54.795220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:54.798555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.824009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.826263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.828339 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.831588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.835386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.839992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.093618 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:55.122919 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1df952f9-bdbe-470d-a56d-dca7da42dadc tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1289 microversion: 2.1 time: 0.342186 Aug 30 04:30:55.124167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 86/184] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:54 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1289 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:55.154977 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad11e9c9afd47f2833edac5f0b83c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b93bd6951d461ba2f6586f3566699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:55.178947 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a4872e86-d7e8-4df7-a352-652419159a2d tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 200 len: 1300 microversion: 2.1 time: 0.901544 Aug 30 04:30:55.179548 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 99/185] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:54 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 1300 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:55.814673 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:55.817054 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:55.840265 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.842391 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.848637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.856203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.860972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.866846 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.161107 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:56.171650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:56.194284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.202107 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.202107 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.208001 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.208543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.208994 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.354313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.367301 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-eaa71c97-ea63-45a5-832b-30c10233f112 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.557253 Aug 30 04:30:56.370465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 87/186] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:55 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:56.385972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.398009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:56.400567 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] [instance: 859b50bf-b0cd-454b-8109-baf01c345feb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:56.403002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-38b215a3-21b6-41cd-bf44-397fff17d608 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1277 microversion: 2.1 time: 0.244412 Aug 30 04:30:56.406081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 100/187] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:56 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:56.419874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.425255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.425976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.427062 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.429255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.429739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.468469 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] HTTP exception thrown: Instance 859b50bf-b0cd-454b-8109-baf01c345feb could not be found. Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Request method failure captured: Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb HTTP/1.1 Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZJdRMEgNrsJS0LYkD61czByFEKIein8619nqg37QuaxNBj6pWu0il-jj1hFhHkmwc3z2gvJQB_mddxxCTUULj297adoMkfBsqYrWEk9hgf3YQyfWMkW2hoQfuk0xDe758hAlcpcd4noPsF93QCwe2JwkeR5hLoFyH-E6OrP8daWuAw Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 92b93bd6951d461ba2f6586f3566699d Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-VolumesNegativeTest-393776474 Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:30:56.470471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/92b93bd6951d461ba2f6586f3566699d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/92b93bd6951d461ba2f6586f3566699d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_92b93bd6951d461ba2f6586f3566699d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/92b93bd6951d461ba2f6586f3566699d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-VolumesNegativeTest-393776474 Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 92b93bd6951d461ba2f6586f3566699d Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-VolumesNegativeTest-393776474 Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-VolumesNegativeTest-393776474-project Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 0ad11e9c9afd47f2833edac5f0b83c61 Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-VolumesNegativeTest-393776474-project Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 859b50bf-b0cd-454b-8109-baf01c345feb could not be found. Aug 30 04:30:56.472631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '859b50bf-b0cd-454b-8109-baf01c345feb'} Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 859b50bf-b0cd-454b-8109-baf01c345feb could not be found. Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:56.473658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 859b50bf-b0cd-454b-8109-baf01c345feb could not be found. Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 859b50bf-b0cd-454b-8109-baf01c345feb could not be found. Aug 30 04:30:56.475352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:30:56.478495 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] Returning 404 to user: Instance 859b50bf-b0cd-454b-8109-baf01c345feb could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:56.478495 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5d979a21-0f1b-493a-b6f4-e14486a8fc77 tempest-VolumesNegativeTest-393776474 tempest-VolumesNegativeTest-393776474-project] 10.222.0.91 "GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb" status: 404 len: 111 microversion: 2.1 time: 0.100145 Aug 30 04:30:56.480626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 88/188] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:56 2022] GET /compute/v2.1/servers/859b50bf-b0cd-454b-8109-baf01c345feb => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:57.399077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:57.404430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:57.433141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:57.435217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:57.445391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.445911 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.448718 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.449183 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.450051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.450745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.452607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.454433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.454922 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.455630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.458347 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.460535 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.998915 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.015513 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-93280179-fd77-4452-9de4-b2bc843271b2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 0.591665 Aug 30 04:30:58.023414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 89/189] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:57 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:58.335114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.363310 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cc6cdf95-8374-407d-b18e-1db04f0f2f92 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.973931 Aug 30 04:30:58.365216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 101/190] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:57 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:59.046486 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.061849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.071144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-e9fd283c-6674-4da4-80ab-9f323d46fbdc req-2a1b3b8f-d25e-4167-99ac-e5d15d82c0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b", "tag": "67dd458e-0cc6-49de-b501-d7686750bff1"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:59.110244 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.110855 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.111515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.112790 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.135167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.136500 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.162365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e9fd283c-6674-4da4-80ab-9f323d46fbdc req-2a1b3b8f-d25e-4167-99ac-e5d15d82c0f6 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.163495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e9fd283c-6674-4da4-80ab-9f323d46fbdc req-2a1b3b8f-d25e-4167-99ac-e5d15d82c0f6 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.164274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e9fd283c-6674-4da4-80ab-9f323d46fbdc req-2a1b3b8f-d25e-4167-99ac-e5d15d82c0f6 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.277007 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-e9fd283c-6674-4da4-80ab-9f323d46fbdc req-2a1b3b8f-d25e-4167-99ac-e5d15d82c0f6 service nova] Creating event network-changed:67dd458e-0cc6-49de-b501-d7686750bff1 for instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b on hv-cinder-85426 Aug 30 04:30:59.315471 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-e9fd283c-6674-4da4-80ab-9f323d46fbdc req-2a1b3b8f-d25e-4167-99ac-e5d15d82c0f6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261283 Aug 30 04:30:59.325833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 102/191] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:59.388891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.389885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.435706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.439222 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.452977 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.460485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.464188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.467370 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.971851 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.987418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fd3401a8-15e3-4865-85f5-fc108f0f34e0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 0.948964 Aug 30 04:30:59.991980 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 90/192] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:00.321870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.362191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c50ff149-de8f-4335-a9cd-819506eb26d9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 0.978968 Aug 30 04:31:00.369268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 103/193] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:01.017249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.026680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.064680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.065905 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.068000 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.070571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.072299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.073004 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.393952 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.397034 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.437046 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.438265 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.442360 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.448188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.450470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.452173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.542803 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.589058 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-075232e8-fc22-47e9-bd5b-5dd9604e475b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 0.582672 Aug 30 04:31:01.609713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 91/194] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:02.206784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:02.452834 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.477329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-596c05f4-f148-43ef-87aa-2129e52402f2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 1.090657 Aug 30 04:31:02.480860 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 104/195] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:02.646373 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:02.648637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:02.671637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:02.685086 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=6 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:02.750188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.752551 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.763421 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.771794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.774252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.776083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.506680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:03.507306 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:03.527572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.528110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.528548 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.557746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.563074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.563533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.966644 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.002467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ee02729d-3500-402c-8b53-78da0963e5dd tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 1.393205 Aug 30 04:31:04.003499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 92/196] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:02 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:04.881688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.892854 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d066a7fc-fc60-432f-9cf3-0fad0d31d26a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1520 microversion: 2.1 time: 1.391623 Aug 30 04:31:04.898574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 105/197] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:03 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1520 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:05.051139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:05.052285 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:05.098689 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.106092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.109077 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.110072 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.121744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.122520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.905647 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.927606 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-422f1579-e9cb-4942-b3f2-e244ae157fa0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 0.886578 Aug 30 04:31:05.937700 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 93/198] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:05 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:05.951612 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:05.955431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:05.982542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.983263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.983968 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.985160 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.985927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.986511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.216699 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1727db86-fc8a-4488-9c02-e5f889d0efaf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: .version_select at 0x7f24ec813940>, body: {"keypair": {"name": "tempest-keypair-1129582369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXLQw5P8Pgj59UcnMw+foqvV339DjJiXf1dENL8rAbrvpCvRJO7TpB9gae/jcRUhmS4a4wrg0YwsttZ/sOCumQtDsSAEnv03v4LbTM8EDOd9J4XADr2J330pGW2cBnXw=="}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:06.366190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-1727db86-fc8a-4488-9c02-e5f889d0efaf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:06.413717 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-1727db86-fc8a-4488-9c02-e5f889d0efaf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:06.587020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1727db86-fc8a-4488-9c02-e5f889d0efaf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.012066 Aug 30 04:31:06.588039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 106/199] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:31:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:31:06.635432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.648571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f5aca0ca-dbd8-478a-8517-774ab1186fe2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1500 microversion: 2.1 time: 0.708854 Aug 30 04:31:06.649835 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 94/200] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:05 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1500 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:06.711314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:06.713555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.739085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.741060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.742560 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.744413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.745597 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.748434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.846604 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=100 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:06.968073 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:06.969108 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.988786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.997288 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.998261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.999196 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.001860 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.002311 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.699053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:07.761915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a6ed7f9c-0e22-49e1-8a30-6154ee066943 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1515 microversion: 2.1 time: 1.077675 Aug 30 04:31:07.770198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 107/201] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:06 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1515 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:07.896453 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:07.965432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-57a3571c-44d9-43a8-9f79-d46407c6ee10 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 0.992537 Aug 30 04:31:07.969301 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 95/202] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:06 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:08.750488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-96d8da4a-195a-4e38-b7c1-3dff569aad26 req-7d4dfe35-d4da-4a82-ab25-36eb74dabf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b", "name": "network-vif-plugged", "status": "completed", "tag": "67dd458e-0cc6-49de-b501-d7686750bff1"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:08.829390 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-96d8da4a-195a-4e38-b7c1-3dff569aad26 req-7d4dfe35-d4da-4a82-ab25-36eb74dabf40 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.835180 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-96d8da4a-195a-4e38-b7c1-3dff569aad26 req-7d4dfe35-d4da-4a82-ab25-36eb74dabf40 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.839763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-96d8da4a-195a-4e38-b7c1-3dff569aad26 req-7d4dfe35-d4da-4a82-ab25-36eb74dabf40 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.921562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-96d8da4a-195a-4e38-b7c1-3dff569aad26 req-7d4dfe35-d4da-4a82-ab25-36eb74dabf40 service nova] Creating event network-vif-plugged:67dd458e-0cc6-49de-b501-d7686750bff1 for instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b on hv-cinder-85426 Aug 30 04:31:08.970707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-96d8da4a-195a-4e38-b7c1-3dff569aad26 req-7d4dfe35-d4da-4a82-ab25-36eb74dabf40 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212115 Aug 30 04:31:08.976196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 108/203] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:31:09.007220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:09.008439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:09.025716 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.026506 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.030350 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.031380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.032030 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.032635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.304939 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:10.322614 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1b6b8ff1-5da5-426c-8a93-ac34cc174666 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 1.318021 Aug 30 04:31:10.325635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 96/204] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:09 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:10.821743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:10.825698 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:10.835511 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.836565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.837243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.838338 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.839241 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.840144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.889313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'flavor' on Instance uuid ba6cd6eb-b345-40aa-9997-edd0e1d35089 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:31:11.314049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f04b196a-683b-41df-8ae5-0715953a36ad tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089/action" status: 200 len: 32 microversion: 2.1 time: 0.502650 Aug 30 04:31:11.320526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 109/205] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:10 2022] POST /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089/action => generated 32 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:31:11.325139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:11.326755 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:11.358811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.359712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.360439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.361237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.361686 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.364737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.388089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:11.393057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:11.445601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.449149 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.451079 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.452355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.457580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.460455 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.803221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.841847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-be0221ea-a85b-49a3-84f2-403a1e799d5a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1319 microversion: 2.1 time: 0.495014 Aug 30 04:31:11.850718 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 110/206] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:11 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:11.941251 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.962489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4413e9ce-5511-441d-8ecc-ac0d505851a6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.641544 Aug 30 04:31:11.964353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 97/207] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:11 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:12.877751 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:12.880810 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:12.883406 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1131249511", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0fa4781-7b10-40fd-9cd8-6b3044f7ba50"}], "security_groups": [{"name": "tempest-securitygroup--371023719"}], "key_name": "tempest-keypair-1129582369", "user_data": "}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:12.900714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.904218 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.905816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.908434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.910031 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.912933 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.303516 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] validate_networks() for [('a0fa4781-7b10-40fd-9cd8-6b3044f7ba50', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:31:13.606591 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:13.652602 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-24251945-b1a1-47cd-aabc-521bb62fac82 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1508 microversion: 2.1 time: 0.792794 Aug 30 04:31:13.665613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 111/208] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:12 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1508 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:13.684787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:13.694020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:13.710851 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.720452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.721396 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.723229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.724192 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.724933 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.012507 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.027627 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4750942c-2be5-4f85-b507-8e9b2fa6137a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.359600 Aug 30 04:31:14.028732 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 112/209] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:13 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:14.465795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:31:14.467001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:31:14.471223 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:31:14.472542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:31:14.475064 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:31:14.544818 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.545820 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.546572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.547999 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.548830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.549600 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.585249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:14.591803 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:14.606410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:31:14.608833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:31:14.776355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7ced7f87-3758-4f04-ad78-2cdc6059a4c1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.898926 Aug 30 04:31:14.778823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 98/210] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:31:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:31:14.798321 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-60df16ca-0b02-4ebd-aebe-cf8b8fda7d29 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:14.798934 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-60df16ca-0b02-4ebd-aebe-cf8b8fda7d29 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:14.912629 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-60df16ca-0b02-4ebd-aebe-cf8b8fda7d29 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.947043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-60df16ca-0b02-4ebd-aebe-cf8b8fda7d29 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1242 microversion: 2.1 time: 0.152487 Aug 30 04:31:14.951835 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 113/211] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:14 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:15.064173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:15.064802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:15.081957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.087344 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.090099 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.090845 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.095357 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.096466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.150143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:15.438529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.460467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-30806dba-b2c6-47be-8158-28605a9db280 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.400306 Aug 30 04:31:15.462808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 99/212] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:15 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:15.984871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:15.986237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:16.002198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.002968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.004160 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.005366 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.007826 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.008798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.224881 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:16.242624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-274d8cc0-0c2a-4d1d-8250-2ada6aff8014 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1238 microversion: 2.1 time: 0.266192 Aug 30 04:31:16.255808 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 114/213] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:15 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1238 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:16.507041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:16.508260 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:16.528692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.529943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.530957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.532799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.533886 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.534924 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.933706 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:16.953454 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-973fb3f1-d87e-4c19-ba37-e471f5fe75ca tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.464059 Aug 30 04:31:16.954299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 100/214] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:16 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:17.282354 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:17.283773 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:17.298934 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.299951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.300600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.301662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.303827 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.305115 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.600981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:17.602203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:17.626077 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.636453 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.637085 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.637931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.642757 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:17.643730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.650113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.676385 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-71d37818-1718-4067-94e9-22e76bc824e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1294 microversion: 2.1 time: 0.396219 Aug 30 04:31:17.680402 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 115/215] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:17 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1294 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:17.720808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a0eb3bb0-bfea-4f06-80d0-c45c03fb0761 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/ips" status: 200 len: 151 microversion: 2.20 time: 0.125388 Aug 30 04:31:17.721733 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 101/216] 10.222.0.91 () {60 vars in 1289 bytes} [Tue Aug 30 04:31:17 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/ips => generated 151 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:31:17.984797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:17.985418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:17.995050 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.995662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.998297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.999109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.999589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.000089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.392878 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.427849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3857e9d2-277b-4fad-b2f8-79179eeff4eb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.447422 Aug 30 04:31:18.435645 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 116/217] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:17 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:18.727170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:18.728081 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:18.743693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.744524 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.745143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.746049 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.746545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.748124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.470569 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:19.471513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:19.484619 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.485131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.485564 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.486298 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.486755 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.487274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.695665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:19.717310 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-247b1b40-9a88-4efc-9867-d0047ba83ff6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.999297 Aug 30 04:31:19.719800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 102/218] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:18 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:19.969193 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:19.990339 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e04b5dc2-85a2-44d9-a6dc-75aefafe1ba3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.522412 Aug 30 04:31:20.001303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 117/219] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:19 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:20.757189 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:20.758126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:20.775334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.779438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.781626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.784367 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.788203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.789801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.835550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:20.836606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:20.853514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.854013 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.854492 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.855293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.855752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.856317 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.910199 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lazy-loading 'flavor' on Instance uuid 72691437-a322-4abe-a51d-6883e8aa8717 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:31:21.481953 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8384abef-bc30-479e-a2aa-84691770ea61 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/action" status: 202 len: 0 microversion: 2.20 time: 0.647693 Aug 30 04:31:21.485532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 118/220] 10.222.0.91 () {62 vars in 1319 bytes} [Tue Aug 30 04:31:20 2022] POST /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:31:21.498398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:21.499549 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:21.506833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:21.511462 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.512749 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.513962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.515316 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.516296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.517156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.675871 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:21.704392 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-dcba7caa-0545-4045-adb9-230dc3e420c2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.951917 Aug 30 04:31:21.714472 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 103/221] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:20 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:21.740984 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:21.742821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:21.755412 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.756196 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.756804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.757805 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.758704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.758704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.188156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.224158 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-af155e11-bf31-4990-883a-42b8944068ae tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.734765 Aug 30 04:31:22.240831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 119/222] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:21 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:22.273393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-2ba4156d-0d11-4d07-9252-b8ee502e92bd req-8f270f1e-98d8-45af-9c9d-1b0b2393fb05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe95c6ff-83ad-4fcd-9d95-59695f830f10", "tag": "a9781c66-5eab-4e93-b9ce-28d28cc15f3c"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:22.294456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-2ba4156d-0d11-4d07-9252-b8ee502e92bd req-8f270f1e-98d8-45af-9c9d-1b0b2393fb05 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.295956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-2ba4156d-0d11-4d07-9252-b8ee502e92bd req-8f270f1e-98d8-45af-9c9d-1b0b2393fb05 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.296974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-2ba4156d-0d11-4d07-9252-b8ee502e92bd req-8f270f1e-98d8-45af-9c9d-1b0b2393fb05 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.324963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-2ba4156d-0d11-4d07-9252-b8ee502e92bd req-8f270f1e-98d8-45af-9c9d-1b0b2393fb05 service nova] Creating event network-changed:a9781c66-5eab-4e93-b9ce-28d28cc15f3c for instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 on hv-cinder-85426 Aug 30 04:31:22.336916 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-2ba4156d-0d11-4d07-9252-b8ee502e92bd req-8f270f1e-98d8-45af-9c9d-1b0b2393fb05 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093539 Aug 30 04:31:22.338221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 120/223] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:22.563048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.600379 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.616113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.618797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cdc127e9-38b9-4604-8ca8-82522c6b2924 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.900703 Aug 30 04:31:22.619830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 104/224] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:21 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:22.754106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:22.754999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:22.782904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.783628 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.785028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.786413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.787398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.788188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.308444 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:23.317242 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:23.334383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.334879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.335515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.336470 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.337240 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.338874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.387817 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.461675 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-259b94fe-5cfd-477b-b8c3-feebe39afd67 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.712119 Aug 30 04:31:23.484753 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 121/225] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:22 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:23.648737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.658952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-18295be6-1bb0-4d9f-be9e-fd8b3140042b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.386765 Aug 30 04:31:23.672592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 105/226] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:23 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:23.672902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:23.672902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:23.692448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.692986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.696506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.699093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.699516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.701257 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.706519 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:23.903181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:23.904545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:23.919116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.921526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.922103 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.924048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.924800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.925473 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.983715 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a3de32c7-1b3b-4f8e-9954-50b66d5ebf05 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/ips" status: 200 len: 145 microversion: 2.1 time: 0.091898 Aug 30 04:31:23.989466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 106/227] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:31:23 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/ips => generated 145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:24.138369 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:24.158650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:24.170486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:24.173946 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f5942031-cfb5-4973-afdd-16ab9f63f7b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.520205 Aug 30 04:31:24.188018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 122/228] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:23 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:24.507566 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:24.508629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:24.518018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:24.530477 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.531818 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.533185 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.536334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.537939 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.539026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.689963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:24.691028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:24.703064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.703935 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.705231 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.706591 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.708836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.710047 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.845899 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:24.847436 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=6 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:24.928333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=6 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:25.198656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.226017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9e9c0dde-2802-46de-ab42-7cfe1c40d925 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.543545 Aug 30 04:31:25.227702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 123/229] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:24 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:25.239521 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:25.241670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:25.272867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:25.275160 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:25.277806 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:25.279166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:25.279986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:25.282172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:25.286183 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.305821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9feecb2a-a4f6-4953-b787-dd304fa44ff0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.798050 Aug 30 04:31:25.320381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 107/230] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:24 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:25.830639 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.848457 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.850067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.851419 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-62d67595-c270-435d-8541-e2556edd33fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.620987 Aug 30 04:31:25.864398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 124/231] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:25 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:26.264243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.265073 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.275623 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.284018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.287035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.288335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.290211 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.291102 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.343529 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.344606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.410611 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.420708 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.421447 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.422652 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.423401 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.424128 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.012938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.033715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ae784313-297e-4449-9ef6-1ec526350783 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.702676 Aug 30 04:31:27.044280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 125/232] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:27.056063 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:27.067824 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:27.090045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.095148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.098070 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.101390 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.102996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.103836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.172537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.245034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-47a235fc-9503-4196-bbc3-ea5cdc79741f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.982921 Aug 30 04:31:27.250502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 108/233] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:27.479728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.546154 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.554932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.565464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8515bcc9-eec9-4afd-aea0-6e85df6414a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.510576 Aug 30 04:31:27.568476 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 126/234] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:27 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:28.088699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.089335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.105015 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.106436 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.107744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.110385 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.112795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.114578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.291540 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.294715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.322094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.322094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.322094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.322836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.328172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.328172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.565581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.608144 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-920fdcea-ff02-4b67-a95e-67984b2b8e94 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.542041 Aug 30 04:31:28.616460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 109/235] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:28.641807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.648219 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.696941 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.697816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.701511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.704268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.705430 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.710174 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.191452 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.205446 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.205446 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.205446 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-bbfef1bb-6c66-42f8-a2d1-6f9671b2684e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.585301 Aug 30 04:31:29.235479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 110/236] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:29.247124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ece2de7-f96a-4d7a-9038-826fb7b16ee5"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:29.250178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.261152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.261842 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.264564 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.264564 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.264564 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.264564 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.397347 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.433564 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-06228ce7-6997-43b9-85be-261174b78d64 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 1.144951 Aug 30 04:31:29.443625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 127/237] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:29.671950 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:29.672717 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.690113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.691700 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.692758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.695896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.698095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.699459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.115770 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-75dcf927-6c60-4889-857a-7d09b0c42208 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875725 Aug 30 04:31:30.145067 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 111/238] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:31:29 2022] POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:30.244204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:30.245663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:30.265967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.274395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.276181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.280237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.281498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.289283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.045447 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.094120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8ff45cb0-e490-4452-938f-aa3041310173 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 1.409660 Aug 30 04:31:31.095215 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 128/239] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:29 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:31.109859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:31.128394 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:31.151094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.151588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.152059 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.152796 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.153293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.165998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.216918 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.254735 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.264731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.272485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7b1e5997-a709-4419-93c8-7654b0c54123 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 1.041034 Aug 30 04:31:31.283971 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 112/240] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:30 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:31.302880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-87ba9b46-e4a6-4be0-9b43-45c7b3074ac0 req-42ad4ef4-2502-4712-886a-5cac659368a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe95c6ff-83ad-4fcd-9d95-59695f830f10", "name": "network-vif-plugged", "status": "completed", "tag": "a9781c66-5eab-4e93-b9ce-28d28cc15f3c"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:31.326664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-87ba9b46-e4a6-4be0-9b43-45c7b3074ac0 req-42ad4ef4-2502-4712-886a-5cac659368a6 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.327692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-87ba9b46-e4a6-4be0-9b43-45c7b3074ac0 req-42ad4ef4-2502-4712-886a-5cac659368a6 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.328799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-87ba9b46-e4a6-4be0-9b43-45c7b3074ac0 req-42ad4ef4-2502-4712-886a-5cac659368a6 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.355261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-87ba9b46-e4a6-4be0-9b43-45c7b3074ac0 req-42ad4ef4-2502-4712-886a-5cac659368a6 service nova] Creating event network-vif-plugged:a9781c66-5eab-4e93-b9ce-28d28cc15f3c for instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 on hv-cinder-85426 Aug 30 04:31:31.371607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-87ba9b46-e4a6-4be0-9b43-45c7b3074ac0 req-42ad4ef4-2502-4712-886a-5cac659368a6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086688 Aug 30 04:31:31.374093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 113/241] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:32.138473 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.148442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.154991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.172860 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.173766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.174569 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.182213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1dc78fb6-bd52-4631-aa81-913cb5181d2c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 1.080231 Aug 30 04:31:32.183269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 129/242] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:31 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:32.193034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.194186 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.194959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.315417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.322956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.394002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.400152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.401507 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.408664 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.410601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.424379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.756102 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.777092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-79730ece-b272-41b8-ab59-8a22bd44ee0b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.650091 Aug 30 04:31:32.780699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 114/243] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:33.219383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:33.220027 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:33.231228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.231737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.234904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.236883 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.241122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.241884 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.495822 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.519561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.524451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.526981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-02ceb1e9-8c02-4b56-88e6-7687d2368974 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 1.220752 Aug 30 04:31:33.548729 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 130/244] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:33.798929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.803088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:33.810309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:33.812278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:33.858669 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.860712 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.862028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.865438 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.867298 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.868547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.888027 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-45a89ddb-01be-4ca7-bea1-883f8b2146c4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.662088 Aug 30 04:31:33.890161 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 115/245] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:33 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:34.380671 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f1ffa49-3ebb-4593-aa26-fafa109e0ff3", "device": "/dev/sdb"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:34.393393 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:34.411083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.416374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.417085 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.420685 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.421417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.422126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.582109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:34.601955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c9e046bf-642b-44f3-af9c-407d392d5829 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1367 microversion: 2.1 time: 0.799726 Aug 30 04:31:34.602565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 131/246] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:33 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1367 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:34.613170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b430f018-f0fa-41fb-b273-e4e4d1f895ea tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:34.631856 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b430f018-f0fa-41fb-b273-e4e4d1f895ea tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.632727 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b430f018-f0fa-41fb-b273-e4e4d1f895ea tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.633311 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b430f018-f0fa-41fb-b273-e4e4d1f895ea tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.815674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b430f018-f0fa-41fb-b273-e4e4d1f895ea tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Going to try to stop instance {{(pid=120846) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:31:35.030733 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b430f018-f0fa-41fb-b273-e4e4d1f895ea tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action" status: 202 len: 0 microversion: 2.1 time: 0.424876 Aug 30 04:31:35.034245 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 132/247] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:34 2022] POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:31:35.044731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:35.047706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:35.062002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:35.062500 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:35.062932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.063644 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:35.071311 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:35.071802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.980886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:35.995354 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.002755 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.004767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5ea9d8c2-e86b-4b3a-bb87-ff748aeb5b4f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.969099 Aug 30 04:31:36.006658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 133/248] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:35 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:36.019059 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:36.019857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:36.039148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.039690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.042570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.043655 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.044168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.044597 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.597945 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d46c13ad-ec15-41fe-b6ee-ebcd0c4afeaf tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "POST /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.222539 Aug 30 04:31:36.605062 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 116/249] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:31:34 2022] POST /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b/os-volume_attachments => generated 194 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:36.613374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:36.615221 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:36.627874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.629898 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.630690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.631736 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.632482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.633354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.918634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.978381 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5abf5e69-07f6-4b10-a1cf-5afa816bc763 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1501 microversion: 2.1 time: 0.964434 Aug 30 04:31:36.996187 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 134/250] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:36 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1501 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:37.038010 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.051390 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.071091 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.073125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.075815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.079331 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.079820 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.080484 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.427104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.440404 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2bf8af6e-214e-4615-ac4c-e18e417b9d9b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.833299 Aug 30 04:31:37.444477 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 117/251] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:36 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:37.459856 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83bdb623-6868-49ba-aa9b-ac33f3433369"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:37.472327 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.496675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.497528 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.497981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.498940 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.499802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.507955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.575604 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] HTTP exception thrown: Cannot 'attach_volume' instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 while it is in vm_state rescued Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Request method failure captured: Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: POST /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089/os-volume_attachments HTTP/1.1 Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 74 Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI5wHVu63y0quaUniqRTR3Rdq3_hKasNXmOKcEjaFEPRz2Q6YV9t3NY4sLsy63qIsgRroIX5HqT2kuff3-AzB400MVTV919FNDOQso0tdigaOajD1MR1Coxjek0embcSMpp6HC91cX_nnjwfXU1h8FkL2oaltPTQuUPtBh1n9Su2tc Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:31:37.588523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 589bd91dbf434099b15ed7a8680f93bb Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {"volumeAttachment": {"volumeId": "83bdb623-6868-49ba-aa9b-ac33f3433369"}} Aug 30 04:31:37.591193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Cannot 'attach_volume' instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 while it is in vm_state rescued Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'server_id': 'ba6cd6eb-b345-40aa-9997-edd0e1d35089', 'body': {'volumeAttachment': {'volumeId': '83bdb623-6868-49ba-aa9b-ac33f3433369'}}} Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:37.592927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 while it is in vm_state rescued Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:37.595490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:37.598830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:37.598830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:37.598830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 while it is in vm_state rescued Aug 30 04:31:37.598830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:31:37.604858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Returning 409 to user: Cannot 'attach_volume' instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 while it is in vm_state rescued {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:37.610298 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-22ecb409-f6a9-4e4e-88e8-bda44aa126b3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.163785 Aug 30 04:31:37.617082 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 118/252] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:31:37 2022] POST /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089/os-volume_attachments => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:31:37.654376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.665754 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.703746 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.705943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.709485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.715492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.720318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.721593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.853626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.868871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ac76ca5e-ecc8-444e-9d4c-54e94790f86e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1557 microversion: 2.1 time: 0.865773 Aug 30 04:31:37.871506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 135/253] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:36 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1557 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:37.887068 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:37.887625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.920945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.921450 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.921898 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.922633 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.923103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.935516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.158349 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:38.195224 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a386c790-52f2-4ee4-9c06-8d4cb1835dd4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089/action" status: 202 len: 0 microversion: 2.1 time: 0.322297 Aug 30 04:31:38.197524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 136/254] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:37 2022] POST /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:31:38.211063 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:38.212059 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:38.226045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.230652 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.231367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.235040 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.235636 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.236125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.560982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-affe6436-49bb-4971-9f27-b304b37e1d86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360257 Aug 30 04:31:38.562447 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 137/255] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:31:38 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-interface => generated 284 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:38.595945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:38.606955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:38.627082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.630800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.634665 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.637908 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.641800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.644815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.678456 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.689966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.697581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.698961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-96ab9a3a-42c1-4dab-bc54-7b3f6f797b5e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 1.069832 Aug 30 04:31:38.699655 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 119/256] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:37 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:38.706144 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:38.707298 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:38.720402 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.721334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.721984 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.723164 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.725353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.726224 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.647967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:39.666890 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d1158855-142b-4e8a-846c-0f35dd3b4181 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.965736 Aug 30 04:31:39.668022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 120/257] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:38 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:39.726999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:39.740819 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:39.741606 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:39.758250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c238f48a-ffa6-426e-bfe8-a3b633426bd9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1509 microversion: 2.1 time: 1.191566 Aug 30 04:31:39.772296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.772649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 138/258] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:38 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1509 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:39.772800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.772800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.772800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.772800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.773311 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.694387 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:40.697801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:40.716225 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.731513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.735288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.739783 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.741398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.748403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.820394 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.830511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.850075 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.854255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f6fa19f9-47e3-4600-a483-a55c06efcfdd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 1.118256 Aug 30 04:31:40.864889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 121/259] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:39 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:40.871766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:40.872669 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:40.888774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.889595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.890165 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.890990 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.893030 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.894486 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.173588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.206433 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d0beaaad-8284-47e1-852b-fe458c9659f6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1509 microversion: 2.1 time: 1.338005 Aug 30 04:31:42.223944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 122/260] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:40 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1509 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:42.234426 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:42.235540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:42.261892 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.262884 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.263589 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.298690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.300065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.301202 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.563705 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.585845 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f0607223-e240-4864-afb8-fe04225fe38f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 1.898820 Aug 30 04:31:42.587557 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 139/261] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:40 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:42.618617 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.629096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.631670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.633092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d166a27e-1586-4ee5-b800-f9ee20ae5a13 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.419804 Aug 30 04:31:42.634349 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 123/262] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:42 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:42.800684 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1f1ffa49-3ebb-4593-aa26-fafa109e0ff3", "create_info": {"type": "qcow2", "new_file": "volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.6cc7fe97-1934-4ea6-ae93-38dafebdc9cb.vhdx", "snapshot_id": "6cc7fe97-1934-4ea6-ae93-38dafebdc9cb"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:42.841453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f61739b9-662a-4f7a-9573-4e7676b7b5de(cell1) {{(pid=120846) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 04:31:42.842734 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.843666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.844539 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.997584 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.998488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.999559 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.054429 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-3940b3ba-c20a-465b-855d-e36d974785cd req-dcc49a32-d5e0-4c21-887b-b8f649f8284b admin admin] 10.222.0.83 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.462477 Aug 30 04:31:43.055875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 140/263] 10.222.0.83 () {64 vars in 1326 bytes} [Tue Aug 30 04:31:42 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:31:43.077163 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3a094dd3-db86-4075-a12f-45f9cafe5179 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Action: 'create', calling method: .version_select at 0x7f24ec847820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1141333383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlAeHtVmyyuFtwQGmd+rOqPdDou5Ds2fvnmI31IZkHRYmSOAU3eYORP2BLdmr271iXgLoBuMGD4LWHdEB8jPwQOLwu8HbTe/5qvOPQzC9z8vL6njqvYfy4xTBugNR+gjg=="}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:43.096458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-3a094dd3-db86-4075-a12f-45f9cafe5179 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Getting quotas for project a89458e4a02d40e4abfd8457f31cc0a4. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:43.103320 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-3a094dd3-db86-4075-a12f-45f9cafe5179 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Getting quotas for user 563dbe8a50e34840b6d5b2f9ff65e29a and project a89458e4a02d40e4abfd8457f31cc0a4. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:43.141360 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3a094dd3-db86-4075-a12f-45f9cafe5179 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.326893 Aug 30 04:31:43.153763 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 124/264] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:31:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:43.245633 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.253541 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.287464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.289674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.293073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.296476 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.297725 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.299353 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.443833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-4d8da18d-68b0-4228-9ed7-5ee458f1c766 req-40d21103-494f-44e1-a122-e99ec6fede2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe95c6ff-83ad-4fcd-9d95-59695f830f10", "tag": "a9781c66-5eab-4e93-b9ce-28d28cc15f3c"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:43.476971 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-4d8da18d-68b0-4228-9ed7-5ee458f1c766 req-40d21103-494f-44e1-a122-e99ec6fede2b service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.480606 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-4d8da18d-68b0-4228-9ed7-5ee458f1c766 req-40d21103-494f-44e1-a122-e99ec6fede2b service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.482944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-4d8da18d-68b0-4228-9ed7-5ee458f1c766 req-40d21103-494f-44e1-a122-e99ec6fede2b service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.531715 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-4d8da18d-68b0-4228-9ed7-5ee458f1c766 req-40d21103-494f-44e1-a122-e99ec6fede2b service nova] Creating event network-changed:a9781c66-5eab-4e93-b9ce-28d28cc15f3c for instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 on hv-cinder-85426 Aug 30 04:31:43.547073 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-4d8da18d-68b0-4228-9ed7-5ee458f1c766 req-40d21103-494f-44e1-a122-e99ec6fede2b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111961 Aug 30 04:31:43.553020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 125/265] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:43.609762 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.610483 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.631231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.632738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.633467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.635043 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.637238 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.638255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.719022 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.731488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6f1563e5-2cd4-45d6-b288-f268231035bc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1509 microversion: 2.1 time: 0.498128 Aug 30 04:31:43.732140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 141/266] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1509 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:43.736976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.746377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.773353 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.773855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.774295 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.778124 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.779969 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.780394 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.042600 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:44.064573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-02722889-0d07-48f1-b144-216b85708d1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.459103 Aug 30 04:31:44.066771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 126/267] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:44.096154 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:44.123594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:44.130784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:44.135848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ae74af7c-74d3-446f-aa66-f8aa7d3c7cbb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1744 microversion: 2.20 time: 0.401711 Aug 30 04:31:44.137891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 142/268] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1744 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:44.773678 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:44.774458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:44.788330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.788821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.789426 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.790381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.791024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.791617 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.090460 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:45.091730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:45.105991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.106691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.109882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.111274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.112262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.113043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.165243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:45.198305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7de4e119-6021-41e5-bbdc-8616a49008db tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1515 microversion: 2.1 time: 0.429072 Aug 30 04:31:45.200481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 127/269] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:44 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:45.211132 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:45.213721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:45.228445 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.229876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.230822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.232579 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.237225 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.238848 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.513052 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:45.528252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-91dd304b-db17-45b6-9fc3-f6430b7e711f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.441699 Aug 30 04:31:45.554789 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 143/270] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:45 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:46.130002 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.180959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.186478 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.189799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2bc3ceaa-5a7c-4b44-b3cf-0963df28c61f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1744 microversion: 2.20 time: 0.986947 Aug 30 04:31:46.203505 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 128/271] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:45 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1744 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:46.563713 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.565559 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.580991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.585229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.586129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.587145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.588470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.591037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.195153 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-591f7ee8-4357-41fa-9f45-f88b1f42247f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'create', calling method: .version_select at 0x7f24ed20c040>, body: {"keypair": {"name": "tempest-keypair-851863934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAffVrCOcNlGNEC9kWZkKSogizC3s9IpttuRpgFzYvRqqfZdBL3c/ON9CZBuSyOt+BnzhWx1A8beU0yZr+6EOZ1D2ZGuDR4IqrEfi5/YnXKZYdaBgGxX6QE7XY4GMoGlWg=="}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:47.246490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-591f7ee8-4357-41fa-9f45-f88b1f42247f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:47.252750 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-591f7ee8-4357-41fa-9f45-f88b1f42247f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for user 589bd91dbf434099b15ed7a8680f93bb and project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:47.306610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-591f7ee8-4357-41fa-9f45-f88b1f42247f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121448 Aug 30 04:31:47.307433 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 129/272] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:31:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:31:47.318268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:47.319301 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:47.342287 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.343397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.344319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.345531 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.354548 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.355571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.536094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.554566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-04f93ed9-740f-4083-92bb-2293f54e191e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.996094 Aug 30 04:31:47.555493 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 144/273] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:46 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:47.898230 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.915815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.917831 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.920377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ac82b36c-0c17-4d5f-b824-1243a2234a4e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1744 microversion: 2.20 time: 0.611606 Aug 30 04:31:47.938717 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 130/274] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:47 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1744 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:48.606350 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:48.607141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:48.622931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.624216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.625100 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.626036 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.626622 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.630859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.954389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:48.955875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:48.978162 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.980365 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.981220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.982185 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.982852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.983498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.201993 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.264467 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1e00daaa-c7dc-4029-87c2-c5ae34826f89 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.662211 Aug 30 04:31:49.286619 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 145/275] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:48 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:49.354704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.375237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.388426 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.400440 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-986a79f8-7ae0-4dd8-ac42-3864237bb9ba tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1744 microversion: 2.20 time: 0.450188 Aug 30 04:31:49.401601 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 131/276] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:48 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1744 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:49.701204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1f1ffa49-3ebb-4593-aa26-fafa109e0ff3", "create_info": {"type": "qcow2", "new_file": "volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.8c76754f-ebc4-4c73-826c-1630eefdd354.vhdx", "snapshot_id": "8c76754f-ebc4-4c73-826c-1630eefdd354"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:49.715422 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.720183 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.721517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.762031 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.765369 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.768526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.815613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-682887e9-1f33-4738-9806-cc3a78a57607 req-1545c4dc-489d-44c0-aef3-2a93ba8d8586 admin admin] 10.222.0.83 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.525610 Aug 30 04:31:49.819708 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 146/277] 10.222.0.83 () {64 vars in 1326 bytes} [Tue Aug 30 04:31:49 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:31:50.267118 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-2e89badf-7a69-4408-a4e3-8d1a6892e1a7 req-61ffa781-9267-4ff8-ac3b-c3644e38beab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "name": "network-vif-plugged", "status": "completed", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:50.290330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-2e89badf-7a69-4408-a4e3-8d1a6892e1a7 req-61ffa781-9267-4ff8-ac3b-c3644e38beab service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.290965 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-2e89badf-7a69-4408-a4e3-8d1a6892e1a7 req-61ffa781-9267-4ff8-ac3b-c3644e38beab service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.292407 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-2e89badf-7a69-4408-a4e3-8d1a6892e1a7 req-61ffa781-9267-4ff8-ac3b-c3644e38beab service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.318584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-2e89badf-7a69-4408-a4e3-8d1a6892e1a7 req-61ffa781-9267-4ff8-ac3b-c3644e38beab service nova] Creating event network-vif-plugged:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:31:50.340548 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-2e89badf-7a69-4408-a4e3-8d1a6892e1a7 req-61ffa781-9267-4ff8-ac3b-c3644e38beab service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106663 Aug 30 04:31:50.341541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 132/278] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:50.347775 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:50.354689 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:50.369106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.369933 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.370621 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.371807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.372503 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.373106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.454656 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:50.455533 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:50.472498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.473158 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.473764 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.474424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.474888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.480031 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:51.012364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:51.030269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-973ac182-1da6-4f0b-bdd2-35f27d9933fb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.708795 Aug 30 04:31:51.038749 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 147/279] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:50 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:51.101545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:51.113825 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:51.116231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:51.118225 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c91ae84c-197c-4f88-92db-5a5306d31e2f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.667988 Aug 30 04:31:51.119189 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 133/280] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:50 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:52.061189 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:52.061772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:52.090289 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=56 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:52.095861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.099893 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.101448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.102975 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.105810 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.108649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.167665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:52.172066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:52.209374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.239099 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.239469 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.247463 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.252256 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.253398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.655664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.659178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:52.678872 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.680707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.685362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9782e50f-c7c9-42ab-9ca5-162769b80788 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.524338 Aug 30 04:31:52.687187 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 134/281] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:52 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:52.868388 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.898163 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1054997843", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d802dd7-2559-4337-b25d-332df8c6e9ad"}], "security_groups": [{"name": "tempest-securitygroup--366647468"}], "key_name": "tempest-keypair-851863934", "user_data": "}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:52.906564 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c62aa40b-ef8a-4795-9dc1-866a93e71c6d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1723 microversion: 2.1 time: 0.857117 Aug 30 04:31:52.907852 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 148/282] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:52 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1723 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:53.726993 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:53.730496 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:53.749434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.750272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.750963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.753295 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.754855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.757836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.179642 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:54.200771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:54.202937 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:54.204635 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b110dca4-5d92-4f69-bc28-9c7b9b4615d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.498734 Aug 30 04:31:54.205851 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 149/283] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:53 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:54.212216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:54.213182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:54.233151 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.237195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.238030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.239351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.240029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.240799 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.699207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:54.716078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a13f0b2f-b646-4e86-ad54-8cb3b265a07a tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1700 microversion: 2.1 time: 0.508644 Aug 30 04:31:54.716548 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 150/284] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:54 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1700 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:54.851779 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1f1ffa49-3ebb-4593-aa26-fafa109e0ff3", "create_info": {"type": "qcow2", "new_file": "volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.c29ad260-311a-44f6-9d8e-7ff8b17ae48a.vhdx", "snapshot_id": "c29ad260-311a-44f6-9d8e-7ff8b17ae48a"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:54.856981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.859504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.859975 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.871439 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.877259 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.878032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.902809 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-8cce3599-a60b-425e-bc69-86d96406c389 req-426e9881-67be-4368-9e4a-24620d86e35b admin admin] 10.222.0.83 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.183454 Aug 30 04:31:54.904220 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 151/285] 10.222.0.83 () {64 vars in 1326 bytes} [Tue Aug 30 04:31:54 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:31:54.912399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a0ecfba7-fd54-4fd0-a35a-b9ecbd7aa569 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:54.920962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0ecfba7-fd54-4fd0-a35a-b9ecbd7aa569 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.921458 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0ecfba7-fd54-4fd0-a35a-b9ecbd7aa569 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.922124 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0ecfba7-fd54-4fd0-a35a-b9ecbd7aa569 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.955530 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a0ecfba7-fd54-4fd0-a35a-b9ecbd7aa569 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Going to try to start instance {{(pid=120846) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:31:55.070184 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a0ecfba7-fd54-4fd0-a35a-b9ecbd7aa569 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action" status: 202 len: 0 microversion: 2.1 time: 0.163972 Aug 30 04:31:55.073277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 152/286] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:54 2022] POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:31:55.091972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:55.094251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:55.110615 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.111357 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.112351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.113823 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.114500 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.115096 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.532694 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:55.550344 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c2ca2d58-66d8-47cb-906d-4ca82285b715 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1709 microversion: 2.1 time: 0.468721 Aug 30 04:31:55.552192 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 153/287] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:55 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1709 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:55.561264 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:55.565757 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:55.579938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.580888 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.582389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.583442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.584355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.585104 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.920677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:55.926363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:55.951435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:55.955312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:55.957110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c96b44c7-537a-4531-a97d-2b8d4b25c005 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.403365 Aug 30 04:31:55.958140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 154/288] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:55 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:56.573980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:56.574507 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:56.582770 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.583178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.583613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.584414 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.584877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.585306 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.839569 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:56.856926 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7e26792b-633a-4df4-9966-acf91a10a4f6 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1709 microversion: 2.1 time: 0.286612 Aug 30 04:31:56.858275 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 155/289] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:56 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1709 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:56.996891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:56.999263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:57.009643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.010517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.011107 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.012437 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.013261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.013906 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.255799 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:57.272423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=8 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:57.284009 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:57.288435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:57.290731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6e306816-64e9-4e7c-a771-d8f3571b1bcc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.302085 Aug 30 04:31:57.291743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 156/290] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:56 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:57.892320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:57.893238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:57.901744 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.902477 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.903087 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.903855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.904369 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.904803 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:58.129779 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:58.141160 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3a03774f-89e7-4582-b63d-c28f79011696 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1709 microversion: 2.1 time: 0.253824 Aug 30 04:31:58.142012 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 157/291] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:57 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1709 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:58.328045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:58.329095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:58.341469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:58.341969 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:58.342715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:58.343487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:58.343976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:58.344410 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:58.548490 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:58.573136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:58.576842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:58.579506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1154b87b-58ce-4b9e-872c-5a2202c649c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.255595 Aug 30 04:31:58.588649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 158/292] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:58 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:59.180337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:59.181541 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:59.193599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.198039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.198507 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.199266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.199725 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.200703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.489533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:59.509614 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0a7282f6-b846-4650-9270-e1d678665110 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1709 microversion: 2.1 time: 0.338049 Aug 30 04:31:59.525294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 159/293] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:59 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1709 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:59.623142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:59.623142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:59.638444 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.639720 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.640974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.655625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.657802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.658875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.058613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:00.079764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:00.083804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:00.086117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2beeae41-57a7-469a-9af3-e730d74bd562 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.475583 Aug 30 04:32:00.096976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 160/294] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:59 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:00.435594 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] validate_networks() for [('1d802dd7-2559-4337-b25d-332df8c6e9ad', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:00.552623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:00.554669 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:00.583083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.583997 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.585072 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.588025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.589686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.590718 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.914959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:01.035962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.048045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-64ec1f12-5d1d-41c6-b62d-7b9214b0bbec tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1709 microversion: 2.1 time: 0.504004 Aug 30 04:32:01.049434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 161/295] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:00 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1709 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:01.286490 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:01.292135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.292632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.293062 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.310785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.311461 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.311850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.345242 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-b9cac6ea-350e-429e-bda2-d89fd620b44b req-5fa1c102-51f1-4c24-b269-07080f7c18aa admin admin] 10.222.0.83 "DELETE /compute/v2.1/os-assisted-volume-snapshots/6cc7fe97-1934-4ea6-ae93-38dafebdc9cb?delete_info=%7B%22file_to_merge%22:%20%22volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.6cc7fe97-1934-4ea6-ae93-38dafebdc9cb.vhdx%22,%20%22volume_id%22:%20%221f1ffa49-3ebb-4593-aa26-fafa109e0ff3%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.279030 Aug 30 04:32:01.346690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 162/296] 10.222.0.83 () {62 vars in 1800 bytes} [Tue Aug 30 04:32:01 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/6cc7fe97-1934-4ea6-ae93-38dafebdc9cb?delete_info=%7B%22file_to_merge%22:%20%22volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.6cc7fe97-1934-4ea6-ae93-38dafebdc9cb.vhdx%22,%20%22volume_id%22:%20%221f1ffa49-3ebb-4593-aa26-fafa109e0ff3%22%7D => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:01.377375 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:01.379389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:01.415808 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.431152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.433377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.440161 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.441490 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.442665 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.542944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:01.545046 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:01.547192 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:01.547192 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:01.547797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:01.599595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.605947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.607432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.632678 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.633570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.648367 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.775972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:01.805753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Getting quotas for user 589bd91dbf434099b15ed7a8680f93bb and project b09f049bcfa64015bf7495ae9ec2924a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:01.851424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:01.878545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:01.916130 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.936593 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.939866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.950365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-50cdd420-01c8-4961-98c6-6716b6c1139a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.595726 Aug 30 04:32:01.964780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 163/297] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:01 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:02.048517 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ef746745-a4b4-4c89-a6a0-4ef4746fec37 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.164607 Aug 30 04:32:02.060585 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 135/298] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:31:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 9182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:32:02.097824 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-861f87f2-8dfd-483f-bfce-142f2d0e0990 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.099853 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-861f87f2-8dfd-483f-bfce-142f2d0e0990 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.112636 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.118050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.142003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.143889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.147093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.148701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.151333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.152314 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.242667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-861f87f2-8dfd-483f-bfce-142f2d0e0990 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:02.276439 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-861f87f2-8dfd-483f-bfce-142f2d0e0990 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1245 microversion: 2.1 time: 0.197247 Aug 30 04:32:02.277426 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 164/299] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1245 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:02.718048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:02.750084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5944b604-b81a-4448-933c-1555375259f3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1713 microversion: 2.1 time: 0.662866 Aug 30 04:32:02.751366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 136/300] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1713 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:03.001206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:03.005422 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:03.039071 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.063464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.064523 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.068565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.073575 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.075364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.340082 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:03.340899 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:03.373136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.373136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.373584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.375505 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.376353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.377100 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.471895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:03.486877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:03.489579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:03.493942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-35cf00f0-46ed-49ff-8fd1-04dab8a49991 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.504333 Aug 30 04:32:03.510746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 165/301] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:03.532024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:03.553443 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a67f672f-b668-4b11-854d-a66db58dbe55 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1249 microversion: 2.1 time: 0.230691 Aug 30 04:32:03.555572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 137/302] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:03 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1249 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:04.535063 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:04.539998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:04.563064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.569110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.570543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.577872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.579161 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.580383 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.597097 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:04.598974 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:04.614408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.615457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.616924 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.619775 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.620632 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.623613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.841680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:04.851875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8ed7de38-65bb-4244-ad07-0e7cb2dc7994 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1297 microversion: 2.1 time: 0.272440 Aug 30 04:32:04.865333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 138/303] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:04 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1297 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:05.367785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.385651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.391243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.393970 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3467cc63-1997-4427-99f3-18a110440581 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.876281 Aug 30 04:32:05.395171 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 166/304] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:04 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:05.766819 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:05.790217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f61739b9-662a-4f7a-9573-4e7676b7b5de(cell1) {{(pid=120847) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 04:32:05.791566 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.792918 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.793907 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.894016 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:05.897853 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:05.906143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.910171 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.912263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.912974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.913691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.914423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.915413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.916117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.916770 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.972169 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-43316cf2-cf09-4b22-85f7-75310c811cf1 req-05c2edac-2b59-45b4-b25b-cc34c4300717 admin admin] 10.222.0.83 "DELETE /compute/v2.1/os-assisted-volume-snapshots/c29ad260-311a-44f6-9d8e-7ff8b17ae48a?delete_info=%7B%22file_to_merge%22:%20%22volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.c29ad260-311a-44f6-9d8e-7ff8b17ae48a.vhdx%22,%20%22volume_id%22:%20%221f1ffa49-3ebb-4593-aa26-fafa109e0ff3%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.341435 Aug 30 04:32:05.975410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 139/305] 10.222.0.83 () {62 vars in 1800 bytes} [Tue Aug 30 04:32:05 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/c29ad260-311a-44f6-9d8e-7ff8b17ae48a?delete_info=%7B%22file_to_merge%22:%20%22volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.c29ad260-311a-44f6-9d8e-7ff8b17ae48a.vhdx%22,%20%22volume_id%22:%20%221f1ffa49-3ebb-4593-aa26-fafa109e0ff3%22%7D => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:32:06.051730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.064103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-910bd753-5849-45fb-b5ef-f350bf0187e4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1305 microversion: 2.1 time: 0.184723 Aug 30 04:32:06.065595 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 167/306] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:05 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:06.420690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.421956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.434406 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.435718 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.436871 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.438376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.439332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.440798 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.705450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.732968 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.736295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.742361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-06025edb-451f-4800-8546-19f43dedf85a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.326728 Aug 30 04:32:06.744097 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 140/307] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:06 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:07.100212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:07.100896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:07.127242 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.130053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.130692 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.131495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.137321 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.137772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.438449 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:07.457546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d492871c-a1e0-4c79-8d29-da41ce9092ac tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1303 microversion: 2.1 time: 0.362395 Aug 30 04:32:07.476403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 168/308] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1303 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:07.793822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:07.798605 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:07.828299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.833022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.834407 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.838927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.841867 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.845241 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.343299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.365385 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.368207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.373253 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9506a009-f3db-4a48-a1e3-ac0c2bd419fd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.585660 Aug 30 04:32:08.383676 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 141/309] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:08.499518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:08.502613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:08.530867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.532853 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.533878 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.535893 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.537513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.538650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.931223 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.973814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-19c19e68-1090-4d44-bbb1-a90c53e291d6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1303 microversion: 2.1 time: 0.485259 Aug 30 04:32:08.997905 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 169/310] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:08 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1303 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:09.405685 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:09.407302 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:09.425834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.426646 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.427266 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.428194 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.428816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.431546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.030772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.031619 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:10.060836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.061445 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.062533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.063280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.064801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.064801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.126764 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:10.147171 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:10.162230 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:10.163693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-015cf14c-7cf8-4410-94a4-2a81debc361c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.767313 Aug 30 04:32:10.184231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 142/311] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:09 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:10.387438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.404127 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.409245 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.410951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.454755 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:10.468413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8164c6e1-23e8-428d-a1b8-7238deee1ad5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.457188 Aug 30 04:32:10.469086 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.488699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.489011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 170/312] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:10 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:10.490127 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.562515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-c182a8fd-b8b6-46cf-b299-25eaf56004a2 req-93f0d5b3-e815-47be-845d-9baaf03365e3 admin admin] 10.222.0.83 "DELETE /compute/v2.1/os-assisted-volume-snapshots/8c76754f-ebc4-4c73-826c-1630eefdd354?delete_info=%7B%22file_to_merge%22:%20%22volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.8c76754f-ebc4-4c73-826c-1630eefdd354.vhdx%22,%20%22volume_id%22:%20%221f1ffa49-3ebb-4593-aa26-fafa109e0ff3%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.376082 Aug 30 04:32:10.563943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 143/313] 10.222.0.83 () {62 vars in 1800 bytes} [Tue Aug 30 04:32:10 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/8c76754f-ebc4-4c73-826c-1630eefdd354?delete_info=%7B%22file_to_merge%22:%20%22volume-1f1ffa49-3ebb-4593-aa26-fafa109e0ff3.8c76754f-ebc4-4c73-826c-1630eefdd354.vhdx%22,%20%22volume_id%22:%20%221f1ffa49-3ebb-4593-aa26-fafa109e0ff3%22%7D => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:11.209546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:11.210168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:11.224289 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.224800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.225248 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.244012 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.244697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.251369 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.313773 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=8 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:11.533130 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:11.538002 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:11.598259 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.599402 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.611095 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.612620 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.613548 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.623353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.742499 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:11.759763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:11.763625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:11.766213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f14929ad-2160-4251-8971-c2d39380444c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.562210 Aug 30 04:32:11.768201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 171/314] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:11 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:11.841119 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=6 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:11.841233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-71e0b5c4-76a5-416f-a9e8-fa3d7bb9911f req-a74f1fac-7d80-41ff-a7ee-dcc317051b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6eea27d-ad1c-4c9e-9da5-a95042f47304", "tag": "8cae059a-7b2c-4abb-9d46-5df4d36ea2ef"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:11.859464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-71e0b5c4-76a5-416f-a9e8-fa3d7bb9911f req-a74f1fac-7d80-41ff-a7ee-dcc317051b1d service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.863680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-71e0b5c4-76a5-416f-a9e8-fa3d7bb9911f req-a74f1fac-7d80-41ff-a7ee-dcc317051b1d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.865827 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-71e0b5c4-76a5-416f-a9e8-fa3d7bb9911f req-a74f1fac-7d80-41ff-a7ee-dcc317051b1d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.894095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-71e0b5c4-76a5-416f-a9e8-fa3d7bb9911f req-a74f1fac-7d80-41ff-a7ee-dcc317051b1d service nova] Creating event network-changed:8cae059a-7b2c-4abb-9d46-5df4d36ea2ef for instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 on hv-cinder-85426 Aug 30 04:32:11.913032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-71e0b5c4-76a5-416f-a9e8-fa3d7bb9911f req-a74f1fac-7d80-41ff-a7ee-dcc317051b1d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077967 Aug 30 04:32:11.914630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 172/315] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:12.047827 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:12.087088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3e7c6e91-d7ce-4723-9cb3-3710906303a4 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.581309 Aug 30 04:32:12.092782 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 144/316] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:11 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:12.836442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:12.838884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:12.851789 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:12.854832 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.869452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.870669 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.872252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.873363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.889903 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.134936 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:13.136051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:13.141656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.149770 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=100 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:13.165463 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.168356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.168775 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.169959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.170926 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.171603 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8095a720-c1d2-44e8-a2c4-aa94311ce6b8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.357248 Aug 30 04:32:13.187959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 173/317] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:12 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:13.188929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.190557 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.195961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.682196 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.700043 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-26f26dcd-b3fb-4949-b4a6-6e0a0244e01b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.579865 Aug 30 04:32:13.701640 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 145/318] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:13 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:14.221131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:14.222664 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:14.238007 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.240595 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.242891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.245480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.246278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.251990 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.486324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:14.501173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:14.503181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:14.504984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f6b5a984-5304-490c-9c68-36b55ee0566b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.287875 Aug 30 04:32:14.506305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 174/319] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:14 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:14.730522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:14.740015 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:14.773925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.774623 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.777044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.777952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.780253 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.781126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.393525 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:15.398847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-456e17f8-469d-473c-99d6-99d4c4cc571e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.677153 Aug 30 04:32:15.425845 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 146/320] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:14 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:15.558622 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:15.559582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:15.588493 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.589971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.593428 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.600017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.602803 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.608256 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.072377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:16.087208 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:16.090378 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:16.092145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e19f9388-af94-4da3-9596-39c17c29a47e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.541061 Aug 30 04:32:16.108457 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 175/321] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:15 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:16.422899 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:16.423553 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:16.440062 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:16.440546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:16.440973 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.441830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:16.442625 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:16.442890 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.544690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:16.545201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:16.561889 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:16.562579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:16.562912 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.565024 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:16.565549 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:16.565992 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.924031 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lazy-loading 'services' on Instance uuid 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:16.985474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.003821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6b029800-90c9-4cd9-85d6-c88456eb2390 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.584115 Aug 30 04:32:17.005657 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 147/322] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:16 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:17.125801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:17.127788 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:17.137598 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.138572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.139232 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.140256 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.140921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.141545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.256114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6ef18875-a82c-4e55-a50c-edbfdd6e13b7 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "DELETE /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b/os-volume_attachments/1f1ffa49-3ebb-4593-aa26-fafa109e0ff3" status: 202 len: 0 microversion: 2.1 time: 0.726899 Aug 30 04:32:17.264489 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 176/323] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:32:16 2022] DELETE /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b/os-volume_attachments/1f1ffa49-3ebb-4593-aa26-fafa109e0ff3 => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:32:17.416752 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.426702 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.434483 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.448966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-27c320b6-56b2-4659-9a41-1b1c790313f1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.318702 Aug 30 04:32:17.449679 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 148/324] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:17 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:18.031471 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:18.032587 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:18.041999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.042867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.044293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.046168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.046937 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.047654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.265267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:18.275206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2bba11b1-a47c-4c8f-993c-672e890e1f71 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.248066 Aug 30 04:32:18.276492 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 177/325] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:18 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:18.277468 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0e63f404-13e6-4a9a-92b8-50b4bf89146a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Action: 'create', calling method: .version_select at 0x7f24ec7090d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1935935893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5x37iSGcAjwRugavI36wKKhjslgrXOQ77uGoPL79WHVVUpXjw+3z6Y5MRFX6y8+tMBLGUFfmxBgRc3Z26H+h9rG0CEY7xSnBAOCw4OnMe56QE7aa5VGxHGt2xnGqdHrA=="}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:18.345650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-0e63f404-13e6-4a9a-92b8-50b4bf89146a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Getting quotas for project da2baee55e704f8cbcf73b9bab63bd9a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:18.356710 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-0e63f404-13e6-4a9a-92b8-50b4bf89146a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Getting quotas for user ba9817cf82004a5e824a93d1b3ede5cb and project da2baee55e704f8cbcf73b9bab63bd9a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:18.403345 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0e63f404-13e6-4a9a-92b8-50b4bf89146a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.134292 Aug 30 04:32:18.417550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 149/326] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:32:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:18.482673 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:18.483495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:18.502598 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1488199963", "imageRef": "5c3b3e56-90af-433e-b970-e004e9c4584b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1935935893", "networks": [{"uuid": "bcb6fd08-3263-4163-96c8-4125846b16e0"}]}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:18.511549 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.512406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.516660 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.517869 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.518594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.519534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.686315 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] validate_networks() for [('bcb6fd08-3263-4163-96c8-4125846b16e0', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:18.874316 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:18.898214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:18.902558 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:18.905488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2441002d-b597-4d5b-aef6-ffdd87de9676 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.428397 Aug 30 04:32:18.932485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 178/327] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:18 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:18.939498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:18.944377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:18.957288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.960341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.960950 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.962586 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.965641 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.965641 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.033913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:32:19.261658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-76313371-a268-4dac-be13-ca7c3e1d8959 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "DELETE /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 204 len: 0 microversion: 2.1 time: 0.331897 Aug 30 04:32:19.263233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 179/328] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:32:18 2022] DELETE /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:19.277282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:19.278472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:19.288060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.288985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.289643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.290610 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.291229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.291815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.563947 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:19.585726 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ac152fce-d9a2-4e0b-9611-ce5b2b5a6971 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1514 microversion: 2.1 time: 0.316232 Aug 30 04:32:19.586863 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 180/329] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:19 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:19.600313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:19.600313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:19.626295 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.627540 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.628591 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.630252 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.631131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.632179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.725865 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:19.726644 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:19.727473 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:19.728231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:19.729035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:19.754334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.755707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.756914 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.758574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.759730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.760866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.800085 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Getting quotas for project da2baee55e704f8cbcf73b9bab63bd9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:19.814388 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Getting quotas for user ba9817cf82004a5e824a93d1b3ede5cb and project da2baee55e704f8cbcf73b9bab63bd9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:19.846096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:19.851033 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c3b3e56-90af-433e-b970-e004e9c4584b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:19.946968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:19.968293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bdcea2da-61e1-44d9-bf8d-3ac263b53f78 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.379593 Aug 30 04:32:19.968996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 181/330] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:19 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:19.978496 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:19.979045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:19.986206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.986686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.987109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.988080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.988603 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.989026 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.033278 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cf7ddf40-fec1-4dc8-ad97-1af6623ea4ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535500 Aug 30 04:32:20.039054 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 150/331] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:32:20.052925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f5113bbd-b065-49e8-9886-80b6bf898c18 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:20.066612 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f5113bbd-b065-49e8-9886-80b6bf898c18 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:20.249896 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f5113bbd-b065-49e8-9886-80b6bf898c18 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.278797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f5113bbd-b065-49e8-9886-80b6bf898c18 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1259 microversion: 2.1 time: 0.232397 Aug 30 04:32:20.291957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 151/332] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:20 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:20.331038 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.345761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.347883 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.349444 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0836ba15-b89d-4724-9727-0a78b60c72f0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.379176 Aug 30 04:32:20.364168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 182/333] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:19 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:20.630354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:20.631418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:20.656461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.657827 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.658872 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.662777 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.663847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.664715 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.953231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.967816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-81935327-cbe1-4f58-b294-d4ff93d59d2d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1514 microversion: 2.1 time: 0.345900 Aug 30 04:32:20.969049 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 152/334] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:20 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:21.001417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:21.002531 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.013813 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.014945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.015538 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.016569 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.017428 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.018238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.261774 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:21.275779 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fc7d0d83-df75-41e0-a3b0-bc0e06f81149 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.280247 Aug 30 04:32:21.289080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 183/335] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:20 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:21.311126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:21.312220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.323538 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.324430 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.325143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.326336 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.326948 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.327757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.400999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:21.402277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.413867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.415181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.415986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.417868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.418562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.419188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.422000 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:21.435940 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-023cabd9-921a-48e3-b7d4-dfa7faad4a7d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1263 microversion: 2.1 time: 0.134342 Aug 30 04:32:21.443641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 153/336] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:21 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:21.588737 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:21.599425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:21.601243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:21.602668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cdce4f37-aaa1-48a8-b45b-f48a1e79ffcf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.207376 Aug 30 04:32:21.603281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 184/337] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:21 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:22.009944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.009944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.019503 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.020429 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.020993 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.021762 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.022332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.022856 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.182305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.191123 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-41f24c23-02b4-4f42-aacf-b0058db28c86 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1514 microversion: 2.1 time: 0.191694 Aug 30 04:32:22.192178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 154/338] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:21 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:22.313555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.314609 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.317887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:22.324214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.324711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.325152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.325870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.326320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.326739 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.472824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.474857 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.482837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.483357 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.483885 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.484670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.485323 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.485909 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.535330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.552258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-217c2c9a-7c9e-4b97-8899-ed3cdba49712 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.244416 Aug 30 04:32:22.554748 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 185/339] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:22 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:22.580133 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.589714 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-45501553-f6ba-4109-af80-eff6b6cc8c66 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1263 microversion: 2.1 time: 0.124691 Aug 30 04:32:22.590313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 155/340] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:22 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1263 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:22.627945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.628594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.636072 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.636570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.637004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.637744 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.638195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.638612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.807384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.817060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.819041 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.820324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2b705204-bfec-4614-af91-58046cd1a8aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.196564 Aug 30 04:32:22.820904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 186/341] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:22 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:23.213512 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:23.214201 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:23.223754 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.224639 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.225372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.226660 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.227504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.228312 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.236170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:23.406003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:23.420222 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5a03e9c3-1a8c-4a42-9f9b-9136016c8c96 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1514 microversion: 2.1 time: 0.210279 Aug 30 04:32:23.421408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 156/342] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:23 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:23.449115 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-541356028", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1141333383", "security_groups": [{"name": "tempest-secgroup-smoke-335718660"}], "networks": [{"uuid": "e4ff8043-5e4a-4e3a-9a47-b3edb69e1f26"}], "block_device_mapping_v2": [{"uuid": "63e77196-33c0-4c75-a42d-04913024ef36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:23.582177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] validate_networks() for [('e4ff8043-5e4a-4e3a-9a47-b3edb69e1f26', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:23.586672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:23.588087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:23.599704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.600683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.601316 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.602804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.603593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.604353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.827295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:23.844005 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-25cbf425-6a4a-4f8d-9c91-c02d47c848fe tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.264385 Aug 30 04:32:23.846463 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 157/343] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:23 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:23.860559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:23.861462 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:23.881346 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.882630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.883364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.884690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.885280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.887209 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.028070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.042477 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d2bd8b7e-9aca-41d2-9ad3-51928606a887 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1263 microversion: 2.1 time: 0.187606 Aug 30 04:32:24.043782 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 158/344] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:23 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1263 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:24.075556 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:24.079998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:24.101484 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.102364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.103051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.104327 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.105069 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.106021 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.283681 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:24.284526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:24.285433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:24.286404 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:24.287453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:24.302864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.303659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.304395 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.305379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.306349 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.307060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.337204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Getting quotas for project a89458e4a02d40e4abfd8457f31cc0a4. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:24.344659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Getting quotas for user 563dbe8a50e34840b6d5b2f9ff65e29a and project a89458e4a02d40e4abfd8457f31cc0a4. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:24.346209 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.362031 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.364268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.366667 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d3d2b1f1-af23-49f3-aed5-f050f412096a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.321081 Aug 30 04:32:24.368042 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 159/345] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:24 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:24.376534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-a523f445-4cda-46cd-b15c-0842c3d60295 req-cdd0c984-6966-46c1-ac4f-e9912f71a2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6eea27d-ad1c-4c9e-9da5-a95042f47304", "name": "network-vif-plugged", "status": "completed", "tag": "8cae059a-7b2c-4abb-9d46-5df4d36ea2ef"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:24.396458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-a523f445-4cda-46cd-b15c-0842c3d60295 req-cdd0c984-6966-46c1-ac4f-e9912f71a2a7 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.397276 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-a523f445-4cda-46cd-b15c-0842c3d60295 req-cdd0c984-6966-46c1-ac4f-e9912f71a2a7 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.397998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-a523f445-4cda-46cd-b15c-0842c3d60295 req-cdd0c984-6966-46c1-ac4f-e9912f71a2a7 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.421203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-a523f445-4cda-46cd-b15c-0842c3d60295 req-cdd0c984-6966-46c1-ac4f-e9912f71a2a7 service nova] Creating event network-vif-plugged:8cae059a-7b2c-4abb-9d46-5df4d36ea2ef for instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 on hv-cinder-85426 Aug 30 04:32:24.431178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-a523f445-4cda-46cd-b15c-0842c3d60295 req-cdd0c984-6966-46c1-ac4f-e9912f71a2a7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060769 Aug 30 04:32:24.432622 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 160/346] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:24.450232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:24.454517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63e77196-33c0-4c75-a42d-04913024ef36',volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:24.462916 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:24.464109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:24.475200 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.476017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.476725 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.478014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.478695 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.479518 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.720841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.729795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e8377042-bd25-4155-bcfc-d1e205c1caa3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1514 microversion: 2.1 time: 0.275841 Aug 30 04:32:24.730386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 161/347] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:24 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:24.735768 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-14cf3237-a7ff-48a5-a707-c23e02653ac0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.290538 Aug 30 04:32:24.736758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 187/348] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:32:24.751027 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6b224ca9-aa59-4236-a8eb-2eadb7dc24e4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:24.752015 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6b224ca9-aa59-4236-a8eb-2eadb7dc24e4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:24.845554 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6b224ca9-aa59-4236-a8eb-2eadb7dc24e4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.858123 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6b224ca9-aa59-4236-a8eb-2eadb7dc24e4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1088 microversion: 2.1 time: 0.112189 Aug 30 04:32:24.859220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 162/349] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:24 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1088 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:24.886634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:24.887271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:24.898547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.899236 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.899872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.900790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.901484 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.902028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.089399 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:25.092392 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:25.092850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.098250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:25.107463 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-509b1a14-5d2d-4968-9f60-7dfb898b937d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.227992 Aug 30 04:32:25.108544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 188/350] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:24 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:25.109929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.110641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.111079 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.111804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.112284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.112701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.197419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.207400 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6cc33d6b-4a01-4b81-859f-1a716c32a7ba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1263 microversion: 2.1 time: 0.128621 Aug 30 04:32:25.208428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 163/351] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:25 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1263 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:25.392271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:25.392888 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:25.400214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.400859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.401281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.402006 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.402444 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.402908 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.553207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.562114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.563527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.564787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9617a0ac-26ca-4c24-9669-d0596c2700a1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.177743 Aug 30 04:32:25.565379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 189/352] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:25 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:25.758115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:25.758849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:25.761434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:25.767615 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.768341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.768555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.769341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.769776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.770189 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.897042 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:25.898357 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:25.909488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.910588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.911360 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.912980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.913805 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.914532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.945673 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.955818 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-42aa1f3d-053c-4d50-8d4b-7c7f4c64e89f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1514 microversion: 2.1 time: 0.203440 Aug 30 04:32:25.956488 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 164/353] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:25 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:26.012101 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.021577 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d35a3f9a-e2aa-4b9e-8162-9ded26d92154 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1138 microversion: 2.1 time: 0.131483 Aug 30 04:32:26.022173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 190/354] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:25 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1138 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:26.146180 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.146852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.154158 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.154666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.155110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.155838 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.156347 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.156749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.231284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.231898 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.263733 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.272716 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.273394 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.274053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.274531 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.274958 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.370110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.379739 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9b026132-d340-4b39-a1cd-e4e4f61b36aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1263 microversion: 2.1 time: 0.152322 Aug 30 04:32:26.381231 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 191/355] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:26 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:26.385145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.394760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1614533f-0573-4462-a978-ea21c924fc20 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.253332 Aug 30 04:32:26.396003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 165/356] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:26 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:26.589711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.590411 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.597379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.598625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.599148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.599946 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.600461 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.600931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.789080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.800565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.802418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.803871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c8a83b32-6573-4bb1-ac62-43e0d5eab3b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1739 microversion: 2.20 time: 0.218582 Aug 30 04:32:26.804563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 192/357] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:26 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:26.979974 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.980688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.990686 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.991248 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.992153 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.993348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.993954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.994435 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.044774 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:27.045653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:27.062668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.063289 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.063843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.064674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.065221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.065650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.222605 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:27.232948 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bdb00dba-629a-4ad3-9d0e-67b327edb315 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1130 microversion: 2.1 time: 0.191836 Aug 30 04:32:27.233746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 193/358] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:27 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1130 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:27.291999 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:27.302057 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-04a801de-0ef5-49a9-92b3-b97082d3a282 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1514 microversion: 2.1 time: 0.326295 Aug 30 04:32:27.302653 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 166/359] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:26 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:27.407599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:27.408620 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:27.434635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:27.436880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.437667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.438243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:27.438367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.439488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.440261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.441168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.468682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.469967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.470688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.474807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.477604 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.478745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.588642 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:27.598407 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-01a82286-c043-4883-b247-304bad2ca030 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1311 microversion: 2.1 time: 0.197939 Aug 30 04:32:27.599273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 194/360] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:27 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:27.809807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:27.819507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c56c90ad-a821-4976-9aa5-349afe88e41e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.394164 Aug 30 04:32:27.820141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 167/361] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:27 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:27.829427 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:27.830127 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:27.838184 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.839015 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.839668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.840624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.841403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.842020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.024981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:28.035183 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:28.036885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:28.038467 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7dc0c816-97bb-4dbb-ad7d-c482a1542751 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1721 microversion: 2.20 time: 0.213299 Aug 30 04:32:28.039039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 195/362] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:27 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:28.273022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:28.276683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:28.304950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.306963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.310596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.314835 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.319266 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.322097 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.350996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:28.366544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:28.381527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.382763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.383420 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.392480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.393600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.396583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.514859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:28.517731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:28.542318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6a367131-77e4-436f-8769-4475ab3b6e4e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1186 microversion: 2.1 time: 0.275851 Aug 30 04:32:28.544676 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 168/363] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:28 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1186 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:28.556630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-e9522082-c85e-4b46-80e2-5c3825910925 req-42738bed-d00e-401b-a774-2797a1ad41b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b", "name": "network-vif-deleted", "tag": "67dd458e-0cc6-49de-b501-d7686750bff1"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:28.563326 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-946d901c-ebc5-4154-b1ad-c412227e49ba tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1304 microversion: 2.1 time: 0.238624 Aug 30 04:32:28.567675 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 196/364] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:28 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:28.586181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-e9522082-c85e-4b46-80e2-5c3825910925 req-42738bed-d00e-401b-a774-2797a1ad41b5 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.589361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-e9522082-c85e-4b46-80e2-5c3825910925 req-42738bed-d00e-401b-a774-2797a1ad41b5 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.590104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-e9522082-c85e-4b46-80e2-5c3825910925 req-42738bed-d00e-401b-a774-2797a1ad41b5 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.612181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-e9522082-c85e-4b46-80e2-5c3825910925 req-42738bed-d00e-401b-a774-2797a1ad41b5 service nova] Creating event network-vif-deleted:67dd458e-0cc6-49de-b501-d7686750bff1 for instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b on hv-cinder-85426 Aug 30 04:32:28.623066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-e9522082-c85e-4b46-80e2-5c3825910925 req-42738bed-d00e-401b-a774-2797a1ad41b5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076057 Aug 30 04:32:28.624947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 169/365] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:28.631089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:28.633940 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:28.644667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.645380 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.645893 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.646784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.647179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.647646 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.724835 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:28.734374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d11b1d5f-88af-42c8-89c4-0a2086a2e8e2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1311 microversion: 2.1 time: 0.111490 Aug 30 04:32:28.734999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 197/366] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:28 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:28.867202 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:28.871532 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:28.885077 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.886026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.886867 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.888336 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.889211 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.889955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.911494 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:28.913189 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:28.924660 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.926072 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.927221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.928836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.930005 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.931204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.996931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-690d2ce6-71e4-4ee7-81b9-402f74f05c25 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/ips" status: 200 len: 150 microversion: 2.1 time: 0.094149 Aug 30 04:32:28.997984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 198/367] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:32:28 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:29.074365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:29.075396 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:29.085880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.087128 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.088188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.089853 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.090575 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.091302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.141206 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.159520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-03bb180b-4f26-48ff-a223-8aad56dc1f52 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1370 microversion: 2.1 time: 0.313382 Aug 30 04:32:29.160683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 170/368] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:28 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:29.296579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.310374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.312775 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.314497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d4d12684-4b39-4520-9248-acdab741a6ce tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1721 microversion: 2.20 time: 0.247801 Aug 30 04:32:29.328309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 199/369] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:29 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:29.579889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:29.582529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:29.596965 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:29.601431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:29.603849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.605050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.606668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.609074 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.610793 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.612342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.625556 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.632178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.633499 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.635011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.638576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.639959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.714570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.714857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.715308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.715746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lazy-loading 'fault' on Instance uuid 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:29.718236 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.730964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-02b41f0a-8911-41de-ae51-299b79ecbd3a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1186 microversion: 2.1 time: 0.159225 Aug 30 04:32:29.739979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 171/370] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:29 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1186 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:29.757470 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:29.762017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:29.764452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.765710 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.766351 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.766887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.768683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.768937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.769522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.776649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-01ab7006-92fb-4e29-b137-78b5c5a0246d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1309 microversion: 2.1 time: 0.187881 Aug 30 04:32:29.777826 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 200/371] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:29 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:29.790955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=8 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:29.865946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.884168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d03caa95-b535-4045-a2ee-a3a479adc61f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1311 microversion: 2.1 time: 0.131546 Aug 30 04:32:29.885176 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 172/372] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:29 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:30.192370 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.193271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.204794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.205637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.206413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.207757 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.208651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.209362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.348690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.349494 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.359543 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.360283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.360850 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.361931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.362661 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.363201 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.421249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:30.437067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8947758c-2d2f-4851-84d4-a77faf624a16 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1563 microversion: 2.1 time: 0.248987 Aug 30 04:32:30.438191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 201/373] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:30.460972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.461487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.468275 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.468774 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.469200 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.470007 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.474271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.474670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.653922 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b17c9e89-7c15-422c-a17b-0cfa86fdbf4a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196985 Aug 30 04:32:30.655000 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 202/374] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:30.658962 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:30.670852 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:30.674231 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.685505 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.686300 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.686484 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:30.687099 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.688171 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.688785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.689523 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.689665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:30.691508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f860f0aa-15bb-4c85-a745-2c07d3bb8dc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1721 microversion: 2.20 time: 0.348924 Aug 30 04:32:30.692549 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 173/375] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1721 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:30.766892 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.768774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.784639 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.785715 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.786699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.788799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.789697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.790593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.899572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:30.919536 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b295c512-7664-4235-85ae-ad53120a006b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1186 microversion: 2.1 time: 0.167601 Aug 30 04:32:30.928742 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 174/376] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1186 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:30.962511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.965035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.976717 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.978624 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.979355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.980658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.981467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.982093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.985724 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:31.047467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.048466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.049318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:31.050066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lazy-loading 'fault' on Instance uuid 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:31.116888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:31.130439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-58cfc5ec-cb84-439f-91b0-6d5d2414ea43 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1309 microversion: 2.1 time: 0.198755 Aug 30 04:32:31.131500 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 175/377] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:31.148529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:31.150051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:31.164254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.165629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.166398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:31.167721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.168797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.169326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:31.303623 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:31.314974 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d10a682a-5d5c-4f47-ac4f-a3b7e645a48b tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1311 microversion: 2.1 time: 0.176171 Aug 30 04:32:31.316038 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 176/378] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:31 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:31.722650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:31.724948 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:31.737555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.738387 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.739141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:31.740490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.741278 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.742001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.013861 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.024626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.026123 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.027728 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-30b4db62-6956-4de7-a229-44092af2c739 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1721 microversion: 2.20 time: 0.312332 Aug 30 04:32:32.028394 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 177/379] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:31 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:32.053613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:32.054578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:32.064650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.065817 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.066765 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.089630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.090461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.091512 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.288509 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.312508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b6f45250-bad5-4154-ab1c-5a8796cad20b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1186 microversion: 2.1 time: 0.266768 Aug 30 04:32:32.313876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 178/380] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:32 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1186 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:32.329988 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-e7feb20c-d1bb-4fbf-b9ab-defde9b8c1b0 req-1ea836f1-f3b9-480b-ba7b-930aa1400cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "name": "network-vif-unplugged", "status": "completed", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:32.354573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-e7feb20c-d1bb-4fbf-b9ab-defde9b8c1b0 req-1ea836f1-f3b9-480b-ba7b-930aa1400cc7 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.355507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-e7feb20c-d1bb-4fbf-b9ab-defde9b8c1b0 req-1ea836f1-f3b9-480b-ba7b-930aa1400cc7 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.356225 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-e7feb20c-d1bb-4fbf-b9ab-defde9b8c1b0 req-1ea836f1-f3b9-480b-ba7b-930aa1400cc7 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.383744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-e7feb20c-d1bb-4fbf-b9ab-defde9b8c1b0 req-1ea836f1-f3b9-480b-ba7b-930aa1400cc7 service nova] Creating event network-vif-unplugged:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:32:32.397331 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-e7feb20c-d1bb-4fbf-b9ab-defde9b8c1b0 req-1ea836f1-f3b9-480b-ba7b-930aa1400cc7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078823 Aug 30 04:32:32.399975 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 179/381] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:32.437173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:32.442199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:32.456953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.457745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.458589 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.460843 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.461273 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.462481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.514811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.515570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.516204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.516840 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lazy-loading 'fault' on Instance uuid 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:32.518575 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-612db0e3-5812-407e-aa4c-74cbeda7f587 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.862304 Aug 30 04:32:32.520212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 203/382] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:32:30 2022] POST /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments => generated 194 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:32.551566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:32.557631 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:32.569818 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.571010 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.572120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.573693 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.574764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.575683 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.604411 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:32.619768 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.640334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a56c3370-b96a-406e-8c7f-ce7709b7c101 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1309 microversion: 2.1 time: 0.224812 Aug 30 04:32:32.649139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 180/383] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:32 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:32.667024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-8675befb-ac26-4b66-86d1-21660574995b req-10e5fb9a-115c-402f-940b-f7ccb7767e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6eea27d-ad1c-4c9e-9da5-a95042f47304", "tag": "8cae059a-7b2c-4abb-9d46-5df4d36ea2ef"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:32.682387 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8675befb-ac26-4b66-86d1-21660574995b req-10e5fb9a-115c-402f-940b-f7ccb7767e64 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.683178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8675befb-ac26-4b66-86d1-21660574995b req-10e5fb9a-115c-402f-940b-f7ccb7767e64 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.684051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8675befb-ac26-4b66-86d1-21660574995b req-10e5fb9a-115c-402f-940b-f7ccb7767e64 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.718725 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-8675befb-ac26-4b66-86d1-21660574995b req-10e5fb9a-115c-402f-940b-f7ccb7767e64 service nova] Creating event network-changed:8cae059a-7b2c-4abb-9d46-5df4d36ea2ef for instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 on hv-cinder-85426 Aug 30 04:32:32.724516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.727485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-8675befb-ac26-4b66-86d1-21660574995b req-10e5fb9a-115c-402f-940b-f7ccb7767e64 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076489 Aug 30 04:32:32.728602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 181/384] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:32.741383 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-795b0285-2a58-4935-97ee-639b0101a993 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1329 microversion: 2.1 time: 0.218702 Aug 30 04:32:32.742412 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 204/385] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:32 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1329 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:33.062116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.063633 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.077674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.078841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.080758 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.082395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.083687 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.084727 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.336520 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.337654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.353728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.354441 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.354898 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.357620 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.358347 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.359956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.451412 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:33.471834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:33.482347 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d940d668-daa5-42d1-a24d-a39de6f31c4c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1194 microversion: 2.1 time: 0.150294 Aug 30 04:32:33.483418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 205/386] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:33 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1194 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:33.504986 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:33.529478 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:33.540301 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b8e66410-c68c-4143-8a8e-b70a0c35ec2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1724 microversion: 2.20 time: 0.478272 Aug 30 04:32:33.540513 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 182/387] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:33 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1724 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:33.596820 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6aba952-3969-4b75-aa1b-2205253f38dd"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:33.608160 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.624520 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.625821 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.626998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.628959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.630480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.631686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.671495 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.673668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.697938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.702839 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.705269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.706059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.706538 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.706973 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.858138 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.864088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.864833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.874089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lazy-loading 'fault' on Instance uuid 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:34.119460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.152418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-96871c70-3a9a-4a31-94d4-64a15150cd54 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 200 len: 1309 microversion: 2.1 time: 0.486526 Aug 30 04:32:34.153675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 183/388] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:33 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 1309 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:34.161084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:34.162664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:34.170731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:34.171532 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:34.172382 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:34.173372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:34.174070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:34.174658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:34.283074 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.317990 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-97f5b67e-888a-4ea3-a563-4e0137ba4df5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1317 microversion: 2.1 time: 0.162230 Aug 30 04:32:34.321061 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 184/389] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:34 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:34.324177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:34.357325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=6 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:34.513395 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-df3a430c-f7ac-498f-97c0-1276bb582d01 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.924249 Aug 30 04:32:34.514580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 206/390] 10.222.0.91 () {62 vars in 1364 bytes} [Tue Aug 30 04:32:33 2022] POST /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments => generated 188 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:32:34.529061 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:34.529824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:34.578748 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:34.579678 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:34.580536 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:34.581887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:34.583704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:34.584594 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:34.805837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.821329 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8ccd187a-eac5-407f-acb5-dfb7c384f33c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1204 microversion: 2.1 time: 0.303325 Aug 30 04:32:34.821949 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 185/391] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:34 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1204 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:35.009497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:35.030545 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:35.056380 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.057537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.058255 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.059237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.059928 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.060563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.155934 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120846) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:32:35.179160 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:35.181651 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:35.194585 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=14 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:35.224156 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.225454 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.226194 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.228157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.228937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.230128 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.248580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] HTTP exception thrown: Instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b could not be found. Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Request method failure captured: Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b HTTP/1.1 Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZJ49yC62be8Kn6_EEFOHGlPgr0Tou0RO2nZpVfdpjoT8CstEQGbquJ7jEoSkD7Ma9YoheWoIO_YblhNncmJ3pBx8EkWqLCyOkClAeFcybVprP9hvpAASs1bEzq4XrdGo7AGHp2Cnux0JWKcNzk63kSfpKeYI6z4xDCTmxiFjSSfjwo Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 9322fbe1939b46c3aee2418884f81e9a Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1056740558 Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:32:35.252581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-VolumesSnapshotTestJSON-1056740558 Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 9322fbe1939b46c3aee2418884f81e9a Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1056740558 Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-VolumesSnapshotTestJSON-1056740558-project Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: f237249974584d938baf71727ea3a162 Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-VolumesSnapshotTestJSON-1056740558-project Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b could not be found. Aug 30 04:32:35.254401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b'} Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b could not be found. Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:35.255157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b could not be found. Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b could not be found. Aug 30 04:32:35.257275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:32:35.260530 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Returning 404 to user: Instance 51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:35.288607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0b799a24-96f0-4be7-b32e-6fc9635d4f94 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b" status: 404 len: 111 microversion: 2.1 time: 0.090603 Aug 30 04:32:35.292967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 186/392] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:35 2022] GET /compute/v2.1/servers/51dbc8a0-f8fe-4f5e-bd92-05f30c39f88b => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:35.356046 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c4251ca7-63d2-4abd-8187-8ccd06611eca tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/action" status: 202 len: 0 microversion: 2.20 time: 0.362868 Aug 30 04:32:35.363240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 207/393] 10.222.0.91 () {62 vars in 1319 bytes} [Tue Aug 30 04:32:34 2022] POST /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:32:35.363809 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:35.364620 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:35.380025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:35.381281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:35.396228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.398508 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.399262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.400728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.401502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.402101 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.403836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.404018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.404771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.404898 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.405304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.409060 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.062432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:36.081587 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:36.083438 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:36.089322 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-49e6d1a1-9117-484e-88db-989e95c73a0f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1810 microversion: 2.20 time: 0.721248 Aug 30 04:32:36.091536 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 208/394] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:35 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1810 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:36.117100 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:36.120062 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:36.136913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.137331 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.137814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.138475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.139103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.139679 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.271839 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:36.300050 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cd937e3a-7dfc-4858-ac21-e7669c31a001 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1204 microversion: 2.1 time: 0.207445 Aug 30 04:32:36.301009 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 209/395] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:36 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1204 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:36.434869 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:36.446643 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-faf8c3ea-2d56-48aa-916e-7e652cfb06df tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 1.094986 Aug 30 04:32:36.450586 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 187/396] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:35 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:37.138992 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:37.145932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:37.173267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.177236 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.178761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.179628 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.180643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.189608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.351398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:37.363985 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:37.427537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.427537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.427537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.435538 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.441109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.443477 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.805163 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:37.854858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-53b119fa-a076-4905-aed7-c5bce5cfd59e tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1204 microversion: 2.1 time: 0.507461 Aug 30 04:32:37.858858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 188/397] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:37 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1204 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:37.885837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:37.892578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:37.935212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.937284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.945082 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.951319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.952950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.960465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.011464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.036704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.038676 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.048959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ff0b14fa-67e2-4c9f-b73e-8b1bfab3b580 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1750 microversion: 2.20 time: 0.912228 Aug 30 04:32:38.056595 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 210/398] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:37 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1750 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:38.333259 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-2e723f3c-5116-4c69-b7de-48b52bf0d094 req-1c308fac-1feb-43ae-afa9-cddb72f5c138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9a6009-b7c3-4bec-9c1f-00487651ecbe", "tag": "d13cb21f-376e-4f2b-9daf-472725dece64"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:38.358701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-2e723f3c-5116-4c69-b7de-48b52bf0d094 req-1c308fac-1feb-43ae-afa9-cddb72f5c138 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.361288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-2e723f3c-5116-4c69-b7de-48b52bf0d094 req-1c308fac-1feb-43ae-afa9-cddb72f5c138 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.364611 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-2e723f3c-5116-4c69-b7de-48b52bf0d094 req-1c308fac-1feb-43ae-afa9-cddb72f5c138 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.428501 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-2e723f3c-5116-4c69-b7de-48b52bf0d094 req-1c308fac-1feb-43ae-afa9-cddb72f5c138 service nova] Creating event network-changed:d13cb21f-376e-4f2b-9daf-472725dece64 for instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe on hv-cinder-85426 Aug 30 04:32:38.444683 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-2e723f3c-5116-4c69-b7de-48b52bf0d094 req-1c308fac-1feb-43ae-afa9-cddb72f5c138 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123621 Aug 30 04:32:38.447790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 211/399] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:38.638587 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7d3c3755-8db8-4050-976f-2d65f17404e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: .version_select at 0x7f24ec5c9ee0>, body: {"keypair": {"name": "tempest-keypair-2096241943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcpzfD4fVDM0XHOJwQ/njhXPDA+o0JN0SzrvtYhEUezN6aHP1sgqo/dx7FzMXdtZQ5DvpEOy3mEAP5Pi7BfxeloCrZgqIGyc4ocZBI3w6GqvLZxVv79fcfG74HAdT274g=="}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:38.681214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-7d3c3755-8db8-4050-976f-2d65f17404e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:38.717337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-7d3c3755-8db8-4050-976f-2d65f17404e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:38.798595 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7d3c3755-8db8-4050-976f-2d65f17404e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168181 Aug 30 04:32:38.807259 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 212/400] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:32:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:38.831737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.853369 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4e9b87d4-9fa0-432b-b834-d72bb090c3b1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.987120 Aug 30 04:32:38.867669 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 189/401] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:37 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:38.904382 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:38.909190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:38.922012 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.927037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.928305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.929748 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.932517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.935537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.070299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:39.070862 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:39.085164 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.087236 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.087787 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.089359 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.090919 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.091472 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.651463 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:39.663221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2b4d9a17-24f1-48fc-92cb-56be01b2af4b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.763885 Aug 30 04:32:39.676807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 213/402] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:38 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:39.881276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:39.882176 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:39.893834 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.894328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.898354 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.899610 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.902361 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.906324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:40.222357 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:40.270096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:40.271647 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:40.272910 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-94439bde-0ecf-4a05-bad1-2ec551fec4c3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1752 microversion: 2.20 time: 1.207949 Aug 30 04:32:40.273476 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 190/403] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:39 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1752 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:40.693014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:40.697024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:40.726083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:40.727476 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:40.733420 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:40.735268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:40.736403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:40.743030 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:40.839877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:40.861663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-23567493-5888-459b-af5d-9b66cd98d004 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.979427 Aug 30 04:32:40.893923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 214/404] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:39 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:41.146044 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-333695341", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "networks": [{"uuid": "aea69756-e786-4cf8-8d76-5170bbdf521b"}]}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:41.254439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:41.279087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-95f262cf-9a20-4e2f-86be-fcd62f593227 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.593033 Aug 30 04:32:41.279317 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] validate_networks() for [('aea69756-e786-4cf8-8d76-5170bbdf521b', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:41.288800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 191/405] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:40 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:41.306423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:41.309332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:41.323183 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.324526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.325550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.326986 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.328148 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.329179 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.743302 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:41.753208 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:41.790901 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:41.797428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:41.801801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f1eba9fb-fd41-4515-b54d-0144766c325c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1752 microversion: 2.20 time: 0.503834 Aug 30 04:32:41.820727 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 192/406] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:41 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1752 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:41.909133 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:41.914653 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:41.962282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.963105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.969533 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.971231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.974539 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.978303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:42.485283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:42.506506 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a8bc98c9-c93b-4f37-aa0d-6a6d9fd086a8 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.609160 Aug 30 04:32:42.520492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 193/407] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:41 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:42.525583 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:42.526473 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:42.533141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:42.534368 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:42.553668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:42.561440 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:42.562328 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:42.563672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:42.934066 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:42.938073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:42.940586 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:42.942693 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:42.948677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:43.004550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.007623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.011823 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.017342 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.022886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.026201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.072598 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:43.087856 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Getting quotas for project 9322fbe1939b46c3aee2418884f81e9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:43.094919 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-69b2a849-1e05-460f-bf44-a8843f30697b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.571054 Aug 30 04:32:43.114634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:43.114922 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 194/408] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:42 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:43.115583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Getting quotas for user f237249974584d938baf71727ea3a162 and project 9322fbe1939b46c3aee2418884f81e9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:43.120570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-616da0b9-f29c-4ee1-95d7-e36fe4ef0de4 req-0f47ebf0-56c3-453e-8b59-1d26dad9bc1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0eee000-87fc-45aa-bb83-92fa9f5b5fab", "tag": "543dac3a-e946-4cd1-8a32-b40f01459925"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:43.145582 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-616da0b9-f29c-4ee1-95d7-e36fe4ef0de4 req-0f47ebf0-56c3-453e-8b59-1d26dad9bc1d service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.155465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-616da0b9-f29c-4ee1-95d7-e36fe4ef0de4 req-0f47ebf0-56c3-453e-8b59-1d26dad9bc1d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.158003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-616da0b9-f29c-4ee1-95d7-e36fe4ef0de4 req-0f47ebf0-56c3-453e-8b59-1d26dad9bc1d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.180973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:43.189323 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:43.214965 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-616da0b9-f29c-4ee1-95d7-e36fe4ef0de4 req-0f47ebf0-56c3-453e-8b59-1d26dad9bc1d service nova] Creating event network-changed:543dac3a-e946-4cd1-8a32-b40f01459925 for instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab on hv-cinder-85426 Aug 30 04:32:43.246098 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-616da0b9-f29c-4ee1-95d7-e36fe4ef0de4 req-0f47ebf0-56c3-453e-8b59-1d26dad9bc1d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144464 Aug 30 04:32:43.246726 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 195/409] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:43.253450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:43.254884 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:43.263368 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.264257 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.265020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.266014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.266633 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.267212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.291216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-87563121-777b-4519-a48f-fe7dc3b9209a tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.155787 Aug 30 04:32:43.294986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 215/410] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:32:43.320611 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b5b01a24-f061-4ab2-a169-d3e26b42838d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:43.322265 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b5b01a24-f061-4ab2-a169-d3e26b42838d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:43.593890 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b5b01a24-f061-4ab2-a169-d3e26b42838d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:43.606918 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b5b01a24-f061-4ab2-a169-d3e26b42838d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1218 microversion: 2.1 time: 0.303168 Aug 30 04:32:43.607887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 216/411] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:43 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1218 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:43.633531 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:43.634858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:43.649364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.650083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.650802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.662832 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.663861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.664550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.050469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.062480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1a7113d8-dd58-4c11-8730-7fca5a2c752c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.440265 Aug 30 04:32:44.063119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 217/412] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:43 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:44.138880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:44.139797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:44.154342 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:44.157114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:44.157873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.160002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:44.160831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:44.164440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.182320 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.244187 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.279036 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.303163 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a3da04d5-b494-4105-b1b0-eaca5a55239f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1752 microversion: 2.20 time: 1.052776 Aug 30 04:32:44.319239 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 196/413] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:43 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1752 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:44.634474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:44.635689 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.635941 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:44.652746 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:44.653414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:44.653877 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.654661 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:44.656645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:44.658572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.663743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-dc5f263e-e08f-4dce-b44c-4ccf5a04a5e1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.529932 Aug 30 04:32:44.669119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 218/414] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:44 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:44.870309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.894151 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-bc4953f0-fb34-4ec9-9fe0-39765434e684 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1222 microversion: 2.1 time: 0.262672 Aug 30 04:32:44.904306 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 197/415] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:44 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:45.086921 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:45.088969 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:45.100836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.102029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.103006 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.105379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.106475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.107475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.281749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-656586834", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0fa4781-7b10-40fd-9cd8-6b3044f7ba50"}], "security_groups": [{"name": "tempest-securitygroup--788753403"}], "key_name": "tempest-keypair-2096241943", "user_data": "}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:45.400268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:45.416816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-901ce518-52b7-441a-8090-a5f0c37cf4f7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.335562 Aug 30 04:32:45.418452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 219/416] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:45 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:45.427215 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:45.428730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:45.453792 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.454864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.455410 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.456518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.457524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.458371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.548440 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] validate_networks() for [('a0fa4781-7b10-40fd-9cd8-6b3044f7ba50', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:45.721955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:45.725433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:45.748237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:45.751695 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:45.754020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2282370a-59d5-4e56-aa48-bfa5f605e0d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.333712 Aug 30 04:32:45.755125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 220/417] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:45 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:45.764075 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:45.765644 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:45.783824 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.785045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.786281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.788030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.789754 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.789754 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.994280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.009586 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5880ab42-34df-473a-85d4-9b3fcd063fa1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.252616 Aug 30 04:32:46.010436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 221/418] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:45 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:46.021190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:46.022325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:46.033238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.033938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.034767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.036333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.036981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.037940 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.134029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:46.134734 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:46.135677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:46.136522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:46.137104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:46.144213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.152249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.152915 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.153474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.154554 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.155166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.155764 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.160557 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5ad670c8-0651-4315-af96-4ac5449533eb tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1222 microversion: 2.1 time: 0.147617 Aug 30 04:32:46.161875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 222/419] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:46 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:46.187083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:46.195539 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:46.223401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:46.228250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:46.347636 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-38e2506a-bfdb-4ad7-87e1-16fe87a0f51b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.073954 Aug 30 04:32:46.349291 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 198/420] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:32:46.369268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-59f4c454-94fd-4909-a7bf-7fd1a64f6b87 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:46.370596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-59f4c454-94fd-4909-a7bf-7fd1a64f6b87 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:46.446283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:46.448179 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:46.461598 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-59f4c454-94fd-4909-a7bf-7fd1a64f6b87 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.462438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.463580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.464642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.466455 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.467569 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.468762 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.477815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-59f4c454-94fd-4909-a7bf-7fd1a64f6b87 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1241 microversion: 2.1 time: 0.115594 Aug 30 04:32:46.486153 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 223/421] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:46 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:46.675515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.684562 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a77ffd90-e97f-4d24-9e58-2637c5983d93 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.245905 Aug 30 04:32:46.685158 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 199/422] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:46 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:46.786383 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:46.787659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:46.795453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.795981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.796474 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.797294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.797659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.798117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.002172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.020064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.023019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.025257 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e3ddf8e2-706a-4550-865a-054d6023006d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.243038 Aug 30 04:32:47.026236 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 224/423] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:46 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:47.038981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.039624 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.047427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.047957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.048408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.049109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.049588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.050024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.207141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.209128 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.216511 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.217212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.217912 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.218841 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.219479 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.220250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.223283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.233476 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ae202538-f6a2-4611-b350-6fedfc332cd1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.199007 Aug 30 04:32:47.234334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 200/424] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:47.318914 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.327497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4aa04f90-9577-49d8-b109-f0a25820057c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1214 microversion: 2.1 time: 0.128817 Aug 30 04:32:47.328115 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 225/425] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:47.514843 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.515498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.524058 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.524800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.525540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.526556 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.527265 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.527956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.606866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.615571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-98ee6dd6-3b20-41be-8324-6b81fb50b86a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1245 microversion: 2.1 time: 0.107099 Aug 30 04:32:47.616738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 201/426] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:47.718407 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.718991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.727544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.728212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.728757 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.729710 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.730189 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.730702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.892125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.901261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-78384827-aef8-4c7c-90c0-6cabb32ed754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.187386 Aug 30 04:32:47.901850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 226/427] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:48.053948 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.054481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.062059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.062611 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.063088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.063875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.064447 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.064951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.220745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.230848 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.232438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.233799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9b7f25ab-2cb7-4880-a003-7edac4130936 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.184370 Aug 30 04:32:48.234412 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 202/428] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:48.257692 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.258317 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.264862 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.265440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.265833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.266582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.267067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.267495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.350720 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.351264 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.353487 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:48.360201 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.360700 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.361252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.361866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.362595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.363083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.437815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.452234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d98957e3-ff18-449e-a53e-7faf7d5134d9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1214 microversion: 2.1 time: 0.105593 Aug 30 04:32:48.453258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 203/429] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:48.467931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.477449 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cbe6e6f2-dfd0-4324-95d6-0c859a246da0 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.224162 Aug 30 04:32:48.478033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 227/430] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:48.655409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.660110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.681497 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.683231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.684162 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.686033 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.686855 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.687882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.778587 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.793712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-62b2b0ff-04e8-4cd8-b30e-3385a8173c90 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1237 microversion: 2.1 time: 0.146042 Aug 30 04:32:48.794749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 204/431] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1237 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:48.926490 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.928212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.941815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.943088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.944110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.945648 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.946672 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.947674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.262920 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.264222 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.295032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.296544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.297474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.298127 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.299380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.300200 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.305159 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.329691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6f1f7d14-6985-4497-9261-efc48705bce7 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.409751 Aug 30 04:32:49.341755 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 228/432] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:49.486820 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.487752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.502690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.505956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.506728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.508079 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.508921 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.520666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.645621 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.656300 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-890fce60-1ded-4658-ac57-42c1b8ec712b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1270 microversion: 2.1 time: 0.173246 Aug 30 04:32:49.656929 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 229/433] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:49.663556 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.664467 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.670902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.671389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.671820 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.672782 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.673411 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.673841 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.720689 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.734873 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.736976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.738466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cea4803e-a54a-4dbd-8f6b-5d1136b5330b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.484396 Aug 30 04:32:49.740043 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 205/434] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:49.828034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.828665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.838141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.838637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.839094 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.840765 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.841431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.842040 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.053263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:50.068979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-dee8371c-e986-4111-a4e8-d79790fb3184 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1293 microversion: 2.1 time: 0.245639 Aug 30 04:32:50.069917 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 206/435] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1293 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:50.148325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:50.160672 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6b9969c2-3a6e-47f0-83bd-f99737359940 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.501768 Aug 30 04:32:50.162432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 230/436] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:50.381389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:50.382933 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:50.397577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.399103 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.400500 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.402126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.403377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.404457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.688058 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:50.689503 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:50.700734 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.702498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.703485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.704576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.705271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.706283 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.813321 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:50.851400 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fe285c97-09f4-4a61-9c18-b4273c97592f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.478283 Aug 30 04:32:50.862772 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 207/437] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:50 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:50.863141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:50.864446 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:50.877861 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.879720 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.881895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.883517 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.884637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.885397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.951035 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lazy-loading 'services' on Instance uuid 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:51.036966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.052494 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0c96765d-09c0-4151-aec7-47109a0d6eb6 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1276 microversion: 2.1 time: 0.196059 Aug 30 04:32:51.053822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 208/438] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:50 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:51.063901 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:51.065006 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:51.086399 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.087445 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.088166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.089224 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.090675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.091378 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.126473 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b103022a-d9c6-496b-b033-bfa38cd44561 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-volume_attachments/0ece2de7-f96a-4d7a-9038-826fb7b16ee5" status: 202 len: 0 microversion: 2.1 time: 0.451427 Aug 30 04:32:51.127414 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 231/439] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:32:50 2022] DELETE /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-volume_attachments/0ece2de7-f96a-4d7a-9038-826fb7b16ee5 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:32:51.139039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:51.139750 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:51.148489 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.149099 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.149651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.150495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.151383 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.151675 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.370276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.394637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c48d4c99-6d17-4cbe-b1c5-db71e6c0dcf7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1299 microversion: 2.1 time: 0.265494 Aug 30 04:32:51.414301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 232/440] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:51 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1299 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:51.426487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:51.427163 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:51.450408 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.450913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.451358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.452181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.456276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.456779 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.685498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.722763 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.725239 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.726491 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f2f4f78f-c6b6-43ec-806c-20e416e66df4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.671372 Aug 30 04:32:51.748050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 209/441] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:51 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:51.886684 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:51.888186 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:51.909692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.910773 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.920742 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.921915 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.922556 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.923155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.954576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.018167 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-983bdfcd-e260-41dd-b5b0-858e9a48d32a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.600119 Aug 30 04:32:52.019784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 233/442] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:51 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:52.094996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:52.105239 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:52.144810 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.149117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.153454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.155784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.156538 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.157158 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.525365 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.528819 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:52.544622 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5d626e57-6de6-4e72-bd50-c3f1485cb56c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.661119 Aug 30 04:32:52.547805 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 210/443] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:51 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:52.560401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:52.561461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:52.579154 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.580695 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.581436 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.582611 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.583716 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.584426 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.585938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.594097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-48233def-ff46-4ab3-84ca-2cda20a73639 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.520396 Aug 30 04:32:52.598656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 234/444] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:52 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:52.764582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:52.765196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:52.776740 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.777396 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.777891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.779331 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.792763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.793530 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.072004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:53.129617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.141665 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.143467 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.144870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8a0150bd-b8bb-42f2-8a28-639a140e0877 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.384237 Aug 30 04:32:53.182351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 235/445] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:52 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:53.202582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.204057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:53.260679 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.262233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.269092 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.283044 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.296786 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.297246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.607019 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.626738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4e67274c-8d8f-49c8-9f31-e04551c3f04a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 1.076520 Aug 30 04:32:53.628113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 211/446] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:52 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:53.646337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-220057de-d544-42cd-b158-52e60200f247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:53.653634 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-220057de-d544-42cd-b158-52e60200f247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.654708 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-220057de-d544-42cd-b158-52e60200f247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.655393 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-220057de-d544-42cd-b158-52e60200f247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.732207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-220057de-d544-42cd-b158-52e60200f247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Going to try to stop instance {{(pid=120847) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:32:53.805745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-220057de-d544-42cd-b158-52e60200f247 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action" status: 202 len: 0 microversion: 2.1 time: 0.176022 Aug 30 04:32:53.808471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 212/447] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:53 2022] POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:53.821369 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.822415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:53.834127 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.835210 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.836763 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.838821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.840212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.841382 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.971333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.983526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1855dbd9-5e38-4c8c-82fd-65d12a3d85e5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.799429 Aug 30 04:32:53.989382 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 236/448] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:53.994935 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.998232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.015511 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.016056 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.016583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.017399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.022276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.022872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.257873 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.291434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5a6d11e9-a6ca-4df3-84bb-d49a55fea758 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.480036 Aug 30 04:32:54.292106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 213/449] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.297434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.298052 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.324400 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.324923 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.325575 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.326126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.326543 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.326967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.442456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.451446 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:54.460035 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0b50e743-e615-42d4-98f4-a4f00717e56c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.467482 Aug 30 04:32:54.463848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 237/450] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.480765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.481609 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.493013 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.493567 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.494017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.501056 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.501574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.502638 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.743554 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.767678 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.773188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.776639 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-587cfd70-db82-411a-9284-be9647a33b55 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.310769 Aug 30 04:32:54.777355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 238/451] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:54.789035 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-cab2fa0d-da47-4f8b-a794-6c9d2d0a3c17 req-5d841a7b-e1c2-434b-abe1-28fe64ce6fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a97f79-ee44-4f9c-bd29-4042d2f4bb2a", "tag": "dd0eb0ed-dd54-4a61-b759-3c573081c4e6"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:54.798340 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.804714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-cab2fa0d-da47-4f8b-a794-6c9d2d0a3c17 req-5d841a7b-e1c2-434b-abe1-28fe64ce6fdd service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.805506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-cab2fa0d-da47-4f8b-a794-6c9d2d0a3c17 req-5d841a7b-e1c2-434b-abe1-28fe64ce6fdd service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.806203 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-cab2fa0d-da47-4f8b-a794-6c9d2d0a3c17 req-5d841a7b-e1c2-434b-abe1-28fe64ce6fdd service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.810016 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cbd61fe6-ee74-414c-84dd-a03134cf6d20 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1677 microversion: 2.1 time: 0.516736 Aug 30 04:32:54.813023 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 214/452] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1677 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.818064 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-9a87cfbc-3400-41d8-a96b-88526dd46464 req-150a25f7-5b86-4268-94cd-7374d6b84152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eee000-87fc-45aa-bb83-92fa9f5b5fab", "name": "network-vif-plugged", "status": "completed", "tag": "543dac3a-e946-4cd1-8a32-b40f01459925"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:54.822052 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-cab2fa0d-da47-4f8b-a794-6c9d2d0a3c17 req-5d841a7b-e1c2-434b-abe1-28fe64ce6fdd service nova] Creating event network-changed:dd0eb0ed-dd54-4a61-b759-3c573081c4e6 for instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a on hv-cinder-85426 Aug 30 04:32:54.828864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-cab2fa0d-da47-4f8b-a794-6c9d2d0a3c17 req-5d841a7b-e1c2-434b-abe1-28fe64ce6fdd service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045541 Aug 30 04:32:54.829767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 239/453] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:54.849129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.855120 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-9a87cfbc-3400-41d8-a96b-88526dd46464 req-150a25f7-5b86-4268-94cd-7374d6b84152 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.855713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-9a87cfbc-3400-41d8-a96b-88526dd46464 req-150a25f7-5b86-4268-94cd-7374d6b84152 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.856278 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-9a87cfbc-3400-41d8-a96b-88526dd46464 req-150a25f7-5b86-4268-94cd-7374d6b84152 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.862697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.883042 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.883870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.885038 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.885393 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-9a87cfbc-3400-41d8-a96b-88526dd46464 req-150a25f7-5b86-4268-94cd-7374d6b84152 service nova] Creating event network-vif-plugged:543dac3a-e946-4cd1-8a32-b40f01459925 for instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab on hv-cinder-85426 Aug 30 04:32:54.886324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.887029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.888418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.898903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-9a87cfbc-3400-41d8-a96b-88526dd46464 req-150a25f7-5b86-4268-94cd-7374d6b84152 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084507 Aug 30 04:32:54.899957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 215/454] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:55.009295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.010853 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.026651 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.028930 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.033078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.033420 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.033981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.036776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.337547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.388581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-68a28fc4-ef5f-4819-bdf5-80f9245afc45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.552335 Aug 30 04:32:55.439248 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 240/455] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:55.464250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.465799 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.496140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.497109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.498952 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.501266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.502982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.506760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.586392 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.609810 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-96e8a23a-f376-4cac-ba92-11d6068f377b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.606066 Aug 30 04:32:55.611557 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 216/456] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:55.632560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-b18ac17e-1e63-4ba9-bd98-970bfcb597bc req-0fe4e96c-0400-4271-a304-068021e6af60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a63575-5a38-460c-9d5b-5184d01154cb", "tag": "2665e87c-c423-4535-b82a-5a19d9770e58"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:55.660383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b18ac17e-1e63-4ba9-bd98-970bfcb597bc req-0fe4e96c-0400-4271-a304-068021e6af60 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.663286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b18ac17e-1e63-4ba9-bd98-970bfcb597bc req-0fe4e96c-0400-4271-a304-068021e6af60 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.665687 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b18ac17e-1e63-4ba9-bd98-970bfcb597bc req-0fe4e96c-0400-4271-a304-068021e6af60 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.688300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-b18ac17e-1e63-4ba9-bd98-970bfcb597bc req-0fe4e96c-0400-4271-a304-068021e6af60 service nova] Creating event network-changed:2665e87c-c423-4535-b82a-5a19d9770e58 for instance 95a63575-5a38-460c-9d5b-5184d01154cb on hv-cinder-85426 Aug 30 04:32:55.700417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-b18ac17e-1e63-4ba9-bd98-970bfcb597bc req-0fe4e96c-0400-4271-a304-068021e6af60 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084738 Aug 30 04:32:55.702226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 217/457] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:55.714177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.715939 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.729253 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.730588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.731831 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.733507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.734717 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.735812 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.742585 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.755887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-88d3869e-5293-41a3-8e7f-2b320f718851 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.312633 Aug 30 04:32:55.757351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 241/458] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:55.803191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.804288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.820354 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.829078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.829962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.830957 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.831627 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.832433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.962371 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.971198 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c43ad214-55f1-4d78-98e6-61003e706bc3 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.266549 Aug 30 04:32:55.984679 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 218/459] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:55.991546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.992580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.022544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.023842 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.032520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.034822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.038856 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.042746 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.170808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:56.182096 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.202694 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.207856 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.210819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-665721d4-2f44-44f3-b9a6-b8df692f9089 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.412075 Aug 30 04:32:56.213533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 242/460] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:56.225058 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=6 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:56.395118 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.409119 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-780bd452-b1f6-435d-befc-19034a8d9262 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1677 microversion: 2.1 time: 0.421945 Aug 30 04:32:56.410701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 219/461] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1677 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:56.443119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.443803 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.454662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.455504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.456278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.457541 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.458355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.459123 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.504763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=14 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:56.642701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.643707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.656397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.657013 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.657734 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.658969 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.661719 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.662833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.721099 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.749080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2b20dfa7-d0fa-4339-a096-49f252fec2c3 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.311444 Aug 30 04:32:56.760055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 243/462] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:56 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:56.802465 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.807268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.826409 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.832663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.834743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.836146 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.837086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.838663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.990807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.014612 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-620fa2b2-cb49-4130-b479-11be4e833390 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.376771 Aug 30 04:32:57.031806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 220/463] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:56 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:57.060017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-dddf22b4-4b3c-44ac-810f-54f050d48e4d req-34c17bb8-f921-4cb3-9f86-7c0b0ef6b876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9a6009-b7c3-4bec-9c1f-00487651ecbe", "name": "network-vif-plugged", "status": "completed", "tag": "d13cb21f-376e-4f2b-9daf-472725dece64"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:57.080241 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-dddf22b4-4b3c-44ac-810f-54f050d48e4d req-34c17bb8-f921-4cb3-9f86-7c0b0ef6b876 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.081685 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-dddf22b4-4b3c-44ac-810f-54f050d48e4d req-34c17bb8-f921-4cb3-9f86-7c0b0ef6b876 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.082743 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-dddf22b4-4b3c-44ac-810f-54f050d48e4d req-34c17bb8-f921-4cb3-9f86-7c0b0ef6b876 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.108397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-dddf22b4-4b3c-44ac-810f-54f050d48e4d req-34c17bb8-f921-4cb3-9f86-7c0b0ef6b876 service nova] Creating event network-vif-plugged:d13cb21f-376e-4f2b-9daf-472725dece64 for instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe on hv-cinder-85426 Aug 30 04:32:57.120284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-dddf22b4-4b3c-44ac-810f-54f050d48e4d req-34c17bb8-f921-4cb3-9f86-7c0b0ef6b876 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077356 Aug 30 04:32:57.122094 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 221/464] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:57.133677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.134857 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.149130 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.149964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.150389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.151337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.151783 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.152400 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.323018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.338643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9617e2c3-91c0-475b-951c-56634a6fd3ed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.545903 Aug 30 04:32:57.340056 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 244/465] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:56 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:57.349089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.350486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.363873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.365300 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.366083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.367593 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.378988 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.386698 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.756041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.777230 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2ead4353-4bb2-469d-80aa-7192b1f2be45 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.652635 Aug 30 04:32:57.779845 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 222/466] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:57.794029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.795904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.815843 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.817192 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.819237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.819890 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.830814 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.830814 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.111601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.151303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.180371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.182637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-476e1671-a994-4df8-a3db-309eb33af9e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1677 microversion: 2.1 time: 0.400434 Aug 30 04:32:58.185744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 223/467] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1677 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:58.191028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.198182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-677d552e-424b-4a62-917a-4c967fc6a424 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.852096 Aug 30 04:32:58.199666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 245/468] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:58.207995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.207995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.209769 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.210372 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.218320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.220541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.221239 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.221686 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.221875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.222489 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.222803 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.223106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.223548 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.229452 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.230500 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.231540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.554580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.574198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-520df55b-7280-44b6-ae9f-a04069d5ad54 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.368575 Aug 30 04:32:58.575181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 246/469] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:58.597312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.599339 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.611944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.627138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.627138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.627138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.627540 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.628077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.628829 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.632129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-51655f8f-65f9-4b34-9f37-a0993fbbb8be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.442910 Aug 30 04:32:58.633151 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 224/470] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:58.814456 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.815188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.825329 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.826167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.826879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.828152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.829002 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.829740 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.882834 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.900185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a519f026-b077-401a-83db-3ea644c84211 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.312222 Aug 30 04:32:58.901571 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 247/471] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:59.066389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.078835 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1ce24a9a-b7db-404a-b858-853efde8e7e2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.269702 Aug 30 04:32:59.079635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 225/472] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:59.215602 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.216731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.227028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.228504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.229691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.231529 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.232760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.233897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.249022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.255370 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.286064 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.293683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.295043 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.299105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.303250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.304503 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.696124 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.710826 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0fe39ae2-f389-442c-ba2f-a9603a4bbc38 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1677 microversion: 2.1 time: 0.501458 Aug 30 04:32:59.711802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 248/473] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1677 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:59.719855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.720565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.737854 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.747552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.748484 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.749270 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.757795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.761044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.761690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.762896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.763254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4bf3294e-28a4-411f-aaf6-a862fd0b4a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.522109 Aug 30 04:32:59.763672 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.773406 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 226/474] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:59.795888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.796877 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.816908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.818115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.818573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.819330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.819791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.820249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.036794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.047584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.056054 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5530dc35-0b26-4ee6-b471-8242e673fcca tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.342624 Aug 30 04:33:00.057612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 249/475] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:00.064542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d0deb652-0a0a-45a7-ad59-1230505027a8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.289545 Aug 30 04:33:00.066699 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.067824 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.084942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.084942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.084942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.084942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.085406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.085406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.086511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 227/476] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:00.102259 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.103413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.111002 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.111931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.112637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.113872 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.115295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.116099 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.139339 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:00.299054 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.314288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-dacd4ba7-1cf3-4c47-bb1d-cac8a912b57c tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.254757 Aug 30 04:33:00.315411 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 250/477] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:00.357397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.368358 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3c544618-cbbb-4b48-b796-583a78346e42 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.270362 Aug 30 04:33:00.368358 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 228/478] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:00.734949 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.736179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.747097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.748078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.748834 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.749638 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.750403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.751093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.812422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.813501 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.824629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.825610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.827155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.827495 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.830576 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.830576 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.111152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.140393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-146d2a1b-8348-497d-979a-72e426edb63f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1677 microversion: 2.1 time: 0.410265 Aug 30 04:33:01.141492 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 251/479] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1677 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:01.171717 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.172344 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.187795 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.188360 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.188804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.189553 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.190013 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.190442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.212523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.230305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.233337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.235542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7f4a706a-a15d-4b90-9dfb-38e8a85e2639 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.430443 Aug 30 04:33:01.237455 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 229/480] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:01.248433 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.249516 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.268010 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.268010 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.268010 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.268821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.269714 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.272739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.435399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.449175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-09fe026b-f485-43fd-8e55-4c0cec039908 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.281271 Aug 30 04:33:01.452216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 252/481] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:01.457884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.459492 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.469438 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.470042 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.470552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.471496 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.471998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.472435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.521103 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.539794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a85e2747-4cf4-4e28-953f-dd0fc206cbf9 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.300094 Aug 30 04:33:01.544243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 230/482] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:01.554693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.556204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.565810 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.566391 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.567029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.568252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.568713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.569206 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.651060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.665589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-dae988d6-6463-46ad-8ac2-e0094bf2c476 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.211201 Aug 30 04:33:01.666635 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 253/483] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:01.753401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.762999 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-dd441339-bef4-4188-886c-fd7fa22ec4b9 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.217333 Aug 30 04:33:01.763570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 231/484] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:02.168785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.169867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.184542 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.185388 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.186136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.187344 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.188539 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.189349 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.261292 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.262177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.271240 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.272084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.272668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.273555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.274106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.274625 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.374538 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.388986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-56207988-4e84-42d0-b4ac-1edb00b016bc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1654 microversion: 2.1 time: 0.228375 Aug 30 04:33:02.389879 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 254/485] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1654 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:02.430992 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fe6b22bc-d4a8-4ada-9355-1af48d0157a9 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:02.442042 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fe6b22bc-d4a8-4ada-9355-1af48d0157a9 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.443679 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fe6b22bc-d4a8-4ada-9355-1af48d0157a9 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.443679 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fe6b22bc-d4a8-4ada-9355-1af48d0157a9 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.451096 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=100 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:02.454853 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.482877 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.483274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fe6b22bc-d4a8-4ada-9355-1af48d0157a9 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Going to try to start instance {{(pid=120846) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:33:02.485964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.488950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9934d01a-a850-42db-8481-0def3084e668 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.232639 Aug 30 04:33:02.491069 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 232/486] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:02.513310 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.514403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.528078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.529899 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.530849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.532091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.532876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.536502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.562799 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fe6b22bc-d4a8-4ada-9355-1af48d0157a9 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action" status: 202 len: 0 microversion: 2.1 time: 0.139547 Aug 30 04:33:02.563786 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 255/487] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:02 2022] POST /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:02.577286 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.578929 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.591132 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.591798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.592568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.594102 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.594861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.595567 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.793390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.804989 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a71147b7-025e-44f5-b572-801f6edb56cc tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.312606 Aug 30 04:33:02.806891 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 233/488] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:02.815626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.817826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.826095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.829781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.831397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.832026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.833740 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.833959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.834602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.835789 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-08d97fd6-6845-4cc9-b375-27948bc00f44 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.266045 Aug 30 04:33:02.836434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 256/489] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:02.841459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.841969 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.849128 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.849443 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.849675 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.850405 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.850863 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.851297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.050961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.056304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.065242 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e8df52dc-3d25-472f-8107-a56dc6eb20c0 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.227673 Aug 30 04:33:03.066226 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 257/490] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:03.071608 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.072263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.079095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.079655 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.079987 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4b1bbb40-9611-4be4-b86b-8a400bf83b08 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1663 microversion: 2.1 time: 0.258726 Aug 30 04:33:03.080184 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.080848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.081405 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.089485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.094096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 234/491] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1663 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:03.299101 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.309325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b6bda412-e0aa-4714-b86d-c3793d088594 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.242285 Aug 30 04:33:03.310004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 258/492] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:03.518312 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.518917 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.527675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.528341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.529042 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.529655 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.530144 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.530698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.717780 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.728614 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.730112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.731592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-912e0667-136d-4903-b02e-5ef358bb79cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.217400 Aug 30 04:33:03.732380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 235/493] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:03.838802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.839623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.842791 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:03.847703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.848446 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.848979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.849711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.850168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.850596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.869922 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.870539 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.877354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.877848 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.878284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.878992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.879676 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.880505 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.018616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.027488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7a365dca-01a2-4417-b455-04f23ba88756 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1259 microversion: 2.1 time: 0.192775 Aug 30 04:33:04.028129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 259/494] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.096823 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.097319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.098296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.108680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.109624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.110709 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.110942 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-14463a93-bfca-4ef1-809c-53a1d96c7a54 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.245046 Aug 30 04:33:04.111691 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 236/495] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.111892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.112707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.113793 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.120188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.121207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.131852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.132697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.133721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.134951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.136880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.138041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.320006 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.335238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-430185a8-a9d4-4dd0-9f23-181ae85082ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1359 microversion: 2.1 time: 0.245747 Aug 30 04:33:04.351524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 260/496] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.370722 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.372186 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.374086 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.392033 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-eb016730-1825-4b1b-8de4-6de810850e55 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1663 microversion: 2.1 time: 0.277659 Aug 30 04:33:04.394746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.397234 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.398466 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.400951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.403234 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.405470 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 237/497] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1663 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.407119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.623565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.633230 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-344b4fb9-4927-4559-a73c-e4359a38866b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.279515 Aug 30 04:33:04.633807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 261/498] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.760486 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.761263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.768384 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.769061 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.769720 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.771722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.772408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.772891 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.994313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.008740 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.011598 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.013638 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d0cab7d5-6e0c-4de9-bc54-e758efb8787b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.258833 Aug 30 04:33:05.028381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 238/499] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:05.052828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.053845 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.063251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.063874 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.064556 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.065836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.066490 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.067004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.141834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.143461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.156012 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.156880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.157657 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.158963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.160249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.161544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.258274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.267653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-00fddff0-da4f-403e-8f9d-049c103771a9 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1442 microversion: 2.1 time: 0.221581 Aug 30 04:33:05.268841 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 262/500] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1442 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:05.291299 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.291952 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.303159 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.304435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.305371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.306651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.307454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.308257 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.358036 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.367087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fdabc2db-3335-4022-971d-af0ca516d2e0 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.234718 Aug 30 04:33:05.368525 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 239/501] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:05.374569 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.375721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.384892 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.385677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.386401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.387261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.388050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.388868 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.523617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.537697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7d4721e6-85df-47f9-9003-d60cf6a8a7bb tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1442 microversion: 2.1 time: 0.249784 Aug 30 04:33:05.538892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 263/502] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1442 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:05.547626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.548719 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.564372 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.565197 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.565752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.567588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.567588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.568272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.576957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.591069 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d0692bff-e7fb-4341-a9be-08aedcea7099 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1549 microversion: 2.1 time: 0.220474 Aug 30 04:33:05.592089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 240/503] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1549 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:05.614769 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.615411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.622550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.623309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.623964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.625077 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.625537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.626116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.847817 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.849866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.864572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-56de7c65-cfc7-4e3d-884e-c7a94ee184dd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1663 microversion: 2.1 time: 0.323539 Aug 30 04:33:05.865841 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 264/504] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1663 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:05.875208 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.876356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.881920 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ebb1713e-20bc-47ed-a590-0f1a4708396a tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1549 microversion: 2.1 time: 0.255452 Aug 30 04:33:05.891168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 241/505] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1549 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:05.891498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.891498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.891498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.891498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.892495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.893260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.911692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.919283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.920683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Searching by: {'deleted': False, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a'} {{(pid=120847) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:33:05.933492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.934390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.935163 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.936564 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.937398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.938199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.070450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.multi_cell_list [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120847) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:33:06.210246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.226145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d2314855-cd7c-48fe-8579-2f4be6aa4497 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.358088 Aug 30 04:33:06.227505 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 265/506] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:06.237279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.239341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.252333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.253829 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.255103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.256640 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.258936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.259113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-980995f4-bd4b-4114-be3b-1f4ff9f7fdff tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.353551 Aug 30 04:33:06.259241 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.259343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 242/507] 10.222.0.91 () {58 vars in 1125 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:06.274502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.275124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.282945 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.283439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.284690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.284690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.285091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.285545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.499684 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.508565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.516209 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8b041c8b-6346-45bf-8b94-5c1062df8fa2 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1549 microversion: 2.1 time: 0.245446 Aug 30 04:33:06.524403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 243/508] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1549 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:06.526196 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.527312 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.529029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.533257 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.537152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0817f38a-13cd-44b5-9856-c16b9c7952c4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.306086 Aug 30 04:33:06.545554 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.546742 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.547387 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.548117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 266/509] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:06.548590 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.550000 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.551197 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.766324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.771823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:06.784665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6eece3d9-d0cb-492f-b666-a92f09dd2c8d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.265481 Aug 30 04:33:06.786038 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 244/510] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:06.905111 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.906433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.923142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.924705 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.925504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.926655 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.928161 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.930313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.249672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:07.250771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:07.259866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.260556 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.261240 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.262454 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.263284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.263869 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.280373 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:07.297977 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c1c9dab4-0684-42a7-811e-93eb01b7d8e0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1663 microversion: 2.1 time: 0.401570 Aug 30 04:33:07.299497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 267/511] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1663 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:07.489801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:07.499542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-caa7b437-4f6c-4982-a3ab-bedd3f3cd7c8 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.254822 Aug 30 04:33:07.500182 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 245/512] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:07 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:07.595226 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:07.597910 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:07.618803 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.620819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.622694 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.624700 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.625962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.627256 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.822335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:07.824554 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:07.836710 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.837277 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.838014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.838997 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.840020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.840985 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.242178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.279171 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.283638 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.290329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6e44b068-ea2a-41c9-9029-ba15aec401e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.700971 Aug 30 04:33:08.290329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 268/513] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:07 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:08.348992 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:08.357156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:08.373501 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.375502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.376803 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.378711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.380251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.381248 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.474431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.492525 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-63772bc3-059c-4673-b5ae-b31a22837d35 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.672332 Aug 30 04:33:08.493711 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 246/514] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:07 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:08.534182 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:08.534829 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:08.559264 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.560288 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.561061 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.562347 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.563191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.576013 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.882692 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.892760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8802ea01-2f40-48b6-b9d9-580185351193 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.363022 Aug 30 04:33:08.893577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 247/515] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:08 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:08.900464 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b9258d3-394a-4efb-933d-328757c4d937"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:08.904507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:08.913944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.914705 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.915308 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.916423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.917012 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.917574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.368759 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.384653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ff0f42ce-3c5f-46cd-aac8-11e2a31204eb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1663 microversion: 2.1 time: 1.046247 Aug 30 04:33:09.385817 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 269/516] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:08 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1663 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:09.401921 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.403078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:09.415033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.415931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.416567 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.417897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.418703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.419437 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.674019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.682098 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:09.698527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.701716 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.704085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fc2dde2f-5f47-4364-a3b3-d22a828396a3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.316428 Aug 30 04:33:09.705097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 270/517] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:09.723134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.725172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:09.736172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.736830 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.737576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.739025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.740839 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.741546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.967276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.978486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-85e060a6-dee9-43bf-8868-795d99382c0c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.271810 Aug 30 04:33:09.979531 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 271/518] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:09.985760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.986701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.000029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.000413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.000852 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.001696 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.002067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.002582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.385645 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:10.402999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7b3e0af6-9a84-434c-9c03-8b00d2d8b82b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.421782 Aug 30 04:33:10.414586 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 272/519] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:10.423056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4b063db0-847f-4db4-a549-87133f5814e9 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.527611 Aug 30 04:33:10.425630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 248/520] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:33:08 2022] POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments => generated 194 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:10.438119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-e76022ea-ca96-4400-aae8-23823925ee43 req-f206856b-7461-40f6-9ab3-390dce0fe311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0eee000-87fc-45aa-bb83-92fa9f5b5fab", "tag": "543dac3a-e946-4cd1-8a32-b40f01459925"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:10.452427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:10.456612 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.479309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.480318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.480953 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e76022ea-ca96-4400-aae8-23823925ee43 req-f206856b-7461-40f6-9ab3-390dce0fe311 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.481315 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.482843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e76022ea-ca96-4400-aae8-23823925ee43 req-f206856b-7461-40f6-9ab3-390dce0fe311 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.483214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.484329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e76022ea-ca96-4400-aae8-23823925ee43 req-f206856b-7461-40f6-9ab3-390dce0fe311 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.484461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.485104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.520886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-e76022ea-ca96-4400-aae8-23823925ee43 req-f206856b-7461-40f6-9ab3-390dce0fe311 service nova] Creating event network-changed:543dac3a-e946-4cd1-8a32-b40f01459925 for instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab on hv-cinder-85426 Aug 30 04:33:10.534451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-e76022ea-ca96-4400-aae8-23823925ee43 req-f206856b-7461-40f6-9ab3-390dce0fe311 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115459 Aug 30 04:33:10.536451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 273/521] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:10.746650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:10.749482 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:10.758578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7cf841ed-c98d-4e4b-bd99-861628d9b382 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1663 microversion: 2.1 time: 0.327838 Aug 30 04:33:10.759683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 249/522] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1663 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:10.761116 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.778995 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.782350 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.783685 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.788127 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.788672 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.789350 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.003285 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.003995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:11.011312 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.011796 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.012263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.013146 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.013586 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.013878 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.045962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.058377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.060751 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.062348 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ad6b2c99-6203-4c00-a1fd-df0dc57e85eb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.331145 Aug 30 04:33:11.063557 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 274/523] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:11.194607 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-64d83fae-bc3f-44d7-aba5-21199322ffeb req-62e86108-14bc-45b7-983c-95a7e66911ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "name": "network-vif-plugged", "status": "completed", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:11.205630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-64d83fae-bc3f-44d7-aba5-21199322ffeb req-62e86108-14bc-45b7-983c-95a7e66911ed service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.206519 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-64d83fae-bc3f-44d7-aba5-21199322ffeb req-62e86108-14bc-45b7-983c-95a7e66911ed service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.207210 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-64d83fae-bc3f-44d7-aba5-21199322ffeb req-62e86108-14bc-45b7-983c-95a7e66911ed service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.223296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-64d83fae-bc3f-44d7-aba5-21199322ffeb req-62e86108-14bc-45b7-983c-95a7e66911ed service nova] Creating event network-vif-plugged:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:33:11.229247 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-64d83fae-bc3f-44d7-aba5-21199322ffeb req-62e86108-14bc-45b7-983c-95a7e66911ed service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038358 Aug 30 04:33:11.230292 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 275/524] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:11.276478 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.286257 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-08f9236a-962a-427c-8de8-0896b4200345 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.286961 Aug 30 04:33:11.286869 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 250/525] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:11.429869 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.430896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:11.439442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.440074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.440579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.441522 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.442341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.442982 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.676488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.691066 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-00e52b93-ec45-4429-a69d-6051cea7915b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.268386 Aug 30 04:33:11.693760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 276/526] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:11 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:11.793863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.795280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:11.803975 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.804621 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.805432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.806834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.807587 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.808398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.002508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.014009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f0cfcfb5-3cdd-4923-9637-e788e607b331 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1667 microversion: 2.1 time: 0.224105 Aug 30 04:33:12.014794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 251/527] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:11 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1667 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:12.088060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:12.088693 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:12.095896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.096522 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.097185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.098361 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.099134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.099631 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.279125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.295366 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.297919 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.299602 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-684efc81-9f68-4af6-920a-b3a7f5deb8c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.216775 Aug 30 04:33:12.301412 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 277/528] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:12 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:12.313741 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:12.314876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:12.327201 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.328110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.328883 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.329955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.330529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.331001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.545288 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.554353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8f5740c1-dff1-437e-8983-acb4aa95e6f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.248649 Aug 30 04:33:12.554943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 252/529] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:12 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:12.724921 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:12.725802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:12.733187 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.734157 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.734751 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.735780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.736340 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.736762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.893829 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.908494 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-56209777-db32-492f-938b-193929f2597c tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.187306 Aug 30 04:33:12.909499 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 278/530] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:12 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:13.340430 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:13.341550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:13.345061 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:13.353454 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.354290 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.355043 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.372288 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.373578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.374430 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.453367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-d4ea6b8c-6a9b-4b94-b39a-affcfda575e2 req-717c2dca-04f9-40bd-b819-901e1567887b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a97f79-ee44-4f9c-bd29-4042d2f4bb2a", "name": "network-vif-plugged", "status": "completed", "tag": "dd0eb0ed-dd54-4a61-b759-3c573081c4e6"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:13.507403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d4ea6b8c-6a9b-4b94-b39a-affcfda575e2 req-717c2dca-04f9-40bd-b819-901e1567887b service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.508812 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d4ea6b8c-6a9b-4b94-b39a-affcfda575e2 req-717c2dca-04f9-40bd-b819-901e1567887b service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.509605 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d4ea6b8c-6a9b-4b94-b39a-affcfda575e2 req-717c2dca-04f9-40bd-b819-901e1567887b service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.579019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-d4ea6b8c-6a9b-4b94-b39a-affcfda575e2 req-717c2dca-04f9-40bd-b819-901e1567887b service nova] Creating event network-vif-plugged:dd0eb0ed-dd54-4a61-b759-3c573081c4e6 for instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a on hv-cinder-85426 Aug 30 04:33:13.605141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-d4ea6b8c-6a9b-4b94-b39a-affcfda575e2 req-717c2dca-04f9-40bd-b819-901e1567887b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163692 Aug 30 04:33:13.610303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 279/531] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:13.633199 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:13.634940 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:13.674030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.677790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.678594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.690377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.691658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.692796 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.759507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:13.797335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:13.800688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:13.803254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-da612945-27ca-4aff-a066-a4e9727e1451 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.467849 Aug 30 04:33:13.806729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 253/532] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:13 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:13.944749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:13.945459 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:13.969114 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.974322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.974975 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.976360 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.978206 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.979285 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.295155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.309536 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f5c0f416-9f8b-4419-96a5-ddc12e095ee1 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.696366 Aug 30 04:33:14.324662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 280/533] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:13 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:14.338172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.340620 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.352799 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.353062 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.355837 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.358244 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.362014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.362847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.368088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.368375 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8ab0dcc2-179a-448f-b7cb-590109729603 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.428712 Aug 30 04:33:14.369132 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 254/534] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:13 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:14.569893 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.580198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6706f828-8a2b-4d94-b912-3d643926fa44 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1595 microversion: 2.1 time: 0.253256 Aug 30 04:33:14.581069 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 281/535] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1595 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:14.842461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.843261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.851559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.852318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.852817 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.853613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.854301 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.855069 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.134490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.152526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.155280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.157451 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-593e7c34-1fb4-4274-a733-094bffc6da0a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.319583 Aug 30 04:33:15.168195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 255/536] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:15.347196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.348303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.357053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.357649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.358164 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.358998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.359596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.360190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.413036 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.414498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.426125 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.428355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.429259 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.430673 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.431613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.432595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.560040 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.569928 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7c2608ce-ff26-4373-86e3-711fdcea61b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.227640 Aug 30 04:33:15.580009 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 282/537] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:15 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:15.791430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-70ef2b90-d40a-4660-8ec0-8cbe298fc0f8 req-9fd61ea0-e522-4ae2-acec-d023744c5c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a63575-5a38-460c-9d5b-5184d01154cb", "name": "network-vif-plugged", "status": "completed", "tag": "2665e87c-c423-4535-b82a-5a19d9770e58"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:15.810396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.813668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-70ef2b90-d40a-4660-8ec0-8cbe298fc0f8 req-9fd61ea0-e522-4ae2-acec-d023744c5c68 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.814833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-70ef2b90-d40a-4660-8ec0-8cbe298fc0f8 req-9fd61ea0-e522-4ae2-acec-d023744c5c68 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.815576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-70ef2b90-d40a-4660-8ec0-8cbe298fc0f8 req-9fd61ea0-e522-4ae2-acec-d023744c5c68 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.829701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b24696c9-5073-47dd-908a-95ad76cdb5f2 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.425113 Aug 30 04:33:15.831251 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 256/538] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:15 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:15.850309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-70ef2b90-d40a-4660-8ec0-8cbe298fc0f8 req-9fd61ea0-e522-4ae2-acec-d023744c5c68 service nova] Creating event network-vif-plugged:2665e87c-c423-4535-b82a-5a19d9770e58 for instance 95a63575-5a38-460c-9d5b-5184d01154cb on hv-cinder-85426 Aug 30 04:33:15.860331 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-70ef2b90-d40a-4660-8ec0-8cbe298fc0f8 req-9fd61ea0-e522-4ae2-acec-d023744c5c68 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076599 Aug 30 04:33:15.861410 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 283/539] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:16.194622 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:16.195242 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.197530 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:16.205580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.206233 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.206829 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.207879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.208482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.209141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.303225 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c93eb6b-cfe5-42e8-85fa-822cf2dba852"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:16.306151 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.313350 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.313958 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.314459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.315192 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.315657 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.316233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.541541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.556519 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.559268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.561537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-591df6b4-04ac-452e-a059-7d9b2c9de8d7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.371615 Aug 30 04:33:16.568833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 257/540] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:16 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:16.605810 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:16.606330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.613066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.613557 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.619953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.619953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.619953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.619953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.925849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-900c1e89-b756-4b7d-88b2-4e90bf78e6a2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626948 Aug 30 04:33:16.934045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 284/541] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:33:16 2022] POST /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:16.940811 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:16.942021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.951685 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.952670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.953381 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.954694 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.955510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.956433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.176856 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.201785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5dd45da4-ec29-4c5e-89b8-26755ff50709 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.270552 Aug 30 04:33:17.204039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 285/542] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:16 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:17.474864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.493404 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-72cc8839-aca1-4eaa-81bb-29d4f8b5c887 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.891380 Aug 30 04:33:17.494404 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 258/543] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:16 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:17.588292 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:17.589192 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:17.599032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.599862 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.601468 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.602045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.602874 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.603606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.844284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.857349 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.859227 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.860660 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ee09ace4-d2a4-4955-8c7c-cac8b1ff0c08 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.276923 Aug 30 04:33:17.861377 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 286/544] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:17 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:17.996249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-da04eedc-60cb-48a9-8e55-ab4413e4400b req-ef93c0a4-18e9-4d0b-b91d-4b3c8d73b754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9a6009-b7c3-4bec-9c1f-00487651ecbe", "tag": "d13cb21f-376e-4f2b-9daf-472725dece64"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:18.015154 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-da04eedc-60cb-48a9-8e55-ab4413e4400b req-ef93c0a4-18e9-4d0b-b91d-4b3c8d73b754 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.015966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-da04eedc-60cb-48a9-8e55-ab4413e4400b req-ef93c0a4-18e9-4d0b-b91d-4b3c8d73b754 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.016931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-da04eedc-60cb-48a9-8e55-ab4413e4400b req-ef93c0a4-18e9-4d0b-b91d-4b3c8d73b754 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.042849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-da04eedc-60cb-48a9-8e55-ab4413e4400b req-ef93c0a4-18e9-4d0b-b91d-4b3c8d73b754 service nova] Creating event network-changed:d13cb21f-376e-4f2b-9daf-472725dece64 for instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe on hv-cinder-85426 Aug 30 04:33:18.053557 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-da04eedc-60cb-48a9-8e55-ab4413e4400b req-ef93c0a4-18e9-4d0b-b91d-4b3c8d73b754 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062664 Aug 30 04:33:18.055384 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 259/545] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:18.239904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:18.240796 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:18.259441 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.260211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.260897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.262014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.262656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.264005 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.523227 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:18.540815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:18.559902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.560749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.561486 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.562497 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.562972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.563622 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.645742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:18.661114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c6850c7a-1175-40b4-a69b-5e306b26b44d tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.427287 Aug 30 04:33:18.663384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 287/546] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:18 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:18.897697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:18.898358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:18.914135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.914631 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.915743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.915743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.916267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.916688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.971413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:18.977931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:18.993856 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-98d76641-b104-44fe-a9a3-35d3d7e6b836 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1366 microversion: 2.1 time: 0.482052 Aug 30 04:33:18.994517 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 260/547] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:18 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:19.225423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.264129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:19.273754 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.276632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.278599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5c61e7ec-5adc-45ec-a1c1-bfc353df03c6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1808 microversion: 2.20 time: 0.385066 Aug 30 04:33:19.290269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 288/548] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:18 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1808 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:19.684252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:19.684875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:19.693747 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.694551 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.694989 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.695713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.696196 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.696617 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.883541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.892315 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c811fd27-6b1c-481b-8fce-fac14498a3f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.212905 Aug 30 04:33:19.892921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 261/549] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:19 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:19.949734 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1872314007"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:19.950276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:19.958273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.958769 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.959261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.960033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.960485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.960908 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.029510 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.030276 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.038065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.038663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.039163 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.039963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.040498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.040929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.117960 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.network.security_group_api [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Adding security group e6ca7ab1-1f1f-4e8c-9a87-4fdaff65ce83 to port d13cb21f-376e-4f2b-9daf-472725dece64 Aug 30 04:33:20.211887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:20.220695 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e114eaf2-bd05-4094-bd9c-cc9241e537d2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1557 microversion: 2.1 time: 0.195151 Aug 30 04:33:20.221611 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 262/550] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:20.245938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.247013 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.257295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.258195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.258921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.260938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.261790 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.262482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.359891 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4810ee32-bb30-4f57-b787-ce3b76cc52fc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121090 Aug 30 04:33:20.361432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 263/551] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:20.370813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.371947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.410023 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.411984 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.413515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.414690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.415535 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.416534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.558642 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f628c882-e4c8-4719-bc9c-548e9c2702a5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/action" status: 202 len: 0 microversion: 2.1 time: 0.612466 Aug 30 04:33:20.559994 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 289/552] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:19 2022] POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:33:20.575174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.576546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.590161 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.591046 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.591832 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.593148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.594033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.594790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.839973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:20.857761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-83433a0f-ea73-4b4f-bed5-9183f11abb9f tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1642 microversion: 2.1 time: 0.291059 Aug 30 04:33:20.858919 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 290/553] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1642 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:20.867719 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-88789c79-53c1-4ab0-bf80-51ea5ce20279 req-55fc29d9-9dff-43ec-95a4-ce044bdce1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9a6009-b7c3-4bec-9c1f-00487651ecbe", "tag": "d13cb21f-376e-4f2b-9daf-472725dece64"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:20.885068 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-88789c79-53c1-4ab0-bf80-51ea5ce20279 req-55fc29d9-9dff-43ec-95a4-ce044bdce1d8 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.885747 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-88789c79-53c1-4ab0-bf80-51ea5ce20279 req-55fc29d9-9dff-43ec-95a4-ce044bdce1d8 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.886951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-88789c79-53c1-4ab0-bf80-51ea5ce20279 req-55fc29d9-9dff-43ec-95a4-ce044bdce1d8 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.902423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-88789c79-53c1-4ab0-bf80-51ea5ce20279 req-55fc29d9-9dff-43ec-95a4-ce044bdce1d8 service nova] Creating event network-changed:d13cb21f-376e-4f2b-9daf-472725dece64 for instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe on hv-cinder-85426 Aug 30 04:33:20.907839 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:20.908764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-88789c79-53c1-4ab0-bf80-51ea5ce20279 req-55fc29d9-9dff-43ec-95a4-ce044bdce1d8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047932 Aug 30 04:33:20.909617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 291/554] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:20.917349 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.918431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.926296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.927714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.928373 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.929482 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.930020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.930643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.932533 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:20.936144 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:20.939253 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5f8f7e44-e280-44c2-b14e-ebe4eb243ae3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1795 microversion: 2.20 time: 0.575763 Aug 30 04:33:20.952537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 264/555] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1795 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:21.134616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:21.146861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9e37d9b6-f042-474f-a5ff-90117ea01945 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.235488 Aug 30 04:33:21.148938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 292/556] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:21.856297 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-7765ad68-8590-4818-a958-b6f3e1322a4b req-b751b57c-f3db-4a7b-9382-f13d5cc17a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a97f79-ee44-4f9c-bd29-4042d2f4bb2a", "tag": "dd0eb0ed-dd54-4a61-b759-3c573081c4e6"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:21.868152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7765ad68-8590-4818-a958-b6f3e1322a4b req-b751b57c-f3db-4a7b-9382-f13d5cc17a70 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:21.868639 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7765ad68-8590-4818-a958-b6f3e1322a4b req-b751b57c-f3db-4a7b-9382-f13d5cc17a70 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:21.869068 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7765ad68-8590-4818-a958-b6f3e1322a4b req-b751b57c-f3db-4a7b-9382-f13d5cc17a70 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:21.882563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-7765ad68-8590-4818-a958-b6f3e1322a4b req-b751b57c-f3db-4a7b-9382-f13d5cc17a70 service nova] Creating event network-changed:dd0eb0ed-dd54-4a61-b759-3c573081c4e6 for instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a on hv-cinder-85426 Aug 30 04:33:21.888049 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-7765ad68-8590-4818-a958-b6f3e1322a4b req-b751b57c-f3db-4a7b-9382-f13d5cc17a70 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035530 Aug 30 04:33:21.888679 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 265/557] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:22.170878 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:22.171966 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:22.180383 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:22.181097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:22.181624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:22.182527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:22.183180 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:22.183707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:22.379173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:22.388476 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f97579a1-5c28-457e-b581-65020bf93d1b tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1318 microversion: 2.1 time: 0.222214 Aug 30 04:33:22.389088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 293/558] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:22 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:23.412658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:23.414093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:23.443868 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.450681 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.462275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.465525 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.468849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.472674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.757949 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:23.766344 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0476c1ba-b584-4358-a906-117e78d48350 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1506 microversion: 2.1 time: 0.358881 Aug 30 04:33:23.766945 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 266/559] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:23 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:23.788764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d6029e5-b7bc-48cf-a02c-c9812ddcea9d", "device": "/dev/sdb"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:23.791751 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:23.798933 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.799421 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.799828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.800614 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.801061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.801631 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.545767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8067a2cd-0498-4506-adf1-352383327dd1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "POST /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761008 Aug 30 04:33:24.548518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 294/560] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:33:23 2022] POST /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:24.946212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:24.949942 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:24.964284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.965055 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.965778 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.966935 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.967627 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.968406 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.014967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'flavor' on Instance uuid a6eea27d-ad1c-4c9e-9da5-a95042f47304 {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:25.221200 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4b3ff55b-6e7c-4d3a-a09e-9bfb28687f50 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/action" status: 200 len: 32 microversion: 2.1 time: 0.282564 Aug 30 04:33:25.229098 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 267/561] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:24 2022] POST /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:33:25.242755 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:25.245816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:25.260976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:25.262135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:25.263433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.264985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:25.266093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:25.268782 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.493911 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:25.503416 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d5acd2f9-7888-4590-a88f-6d9a6530f9ff tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.271773 Aug 30 04:33:25.505667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 295/562] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:25 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:26.537914 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:26.538965 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:26.546893 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:26.547532 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:26.548130 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:26.548925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:26.549468 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:26.550185 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:26.707304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:26.716778 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f78299b5-9b28-4bf2-8dd0-0b44d6b035ec tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.184086 Aug 30 04:33:26.717376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 268/563] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:26 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:27.742941 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:27.744857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:27.753297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.754084 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.754837 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.756786 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.757553 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.758134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.963957 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:27.980955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d6050a05-9177-41ec-97b6-fda91a42cb00 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.243649 Aug 30 04:33:27.982090 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 296/564] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:27 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:28.586427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "8d6029e5-b7bc-48cf-a02c-c9812ddcea9d", "create_info": {"type": "qcow2", "new_file": "volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.a13e53ae-0189-431c-8f11-dfbded9dcd5b.vhdx", "snapshot_id": "a13e53ae-0189-431c-8f11-dfbded9dcd5b"}}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:28.592752 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.593590 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.594353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.612276 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.613054 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.614226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.633132 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-d72e12e3-5468-4002-af83-85c458cdc5b7 req-6e2b4302-f5e7-468b-955c-f04fb059f5c7 admin admin] 10.222.0.83 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.130120 Aug 30 04:33:28.633735 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 269/565] 10.222.0.83 () {64 vars in 1326 bytes} [Tue Aug 30 04:33:28 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:33:29.008363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:29.009412 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:29.021207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.022081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.022871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.024043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.024872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.025638 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.226281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:29.235677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9162ea8b-f815-4a3b-922c-c55f3a13d847 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.234921 Aug 30 04:33:29.236307 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 297/566] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:28 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:30.261598 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:30.262313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:30.269660 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:30.270140 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:30.270778 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:30.272030 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:30.272519 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:30.272947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:30.468607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:30.480088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-db365651-02ea-4cf3-bd80-70983c76b88f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.223430 Aug 30 04:33:30.480760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 270/567] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:30 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:31.503967 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:31.504849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:31.514586 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:31.515134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:31.515642 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:31.516968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:31.517157 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:31.517635 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:31.704928 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:31.719607 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-44a3de7a-974f-4dd1-8e3d-6be3dd258c95 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.220431 Aug 30 04:33:31.720594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 298/568] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:31 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:32.742588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:32.743381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:32.750704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.751496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.751979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.752738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.753202 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.753630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.861510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "8d6029e5-b7bc-48cf-a02c-c9812ddcea9d", "create_info": {"type": "qcow2", "new_file": "volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.cbfdaaab-0667-459f-a5ca-e3659ba1815a.vhdx", "snapshot_id": "cbfdaaab-0667-459f-a5ca-e3659ba1815a"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:32.865340 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.865834 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.866277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.875722 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.876257 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.876691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.892054 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-72b51b2d-9d52-4b2a-a15a-3f57d00f6be1 req-932a573c-5beb-4873-8568-ca395754c45a admin admin] 10.222.0.83 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.118829 Aug 30 04:33:32.892678 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 299/569] 10.222.0.83 () {64 vars in 1326 bytes} [Tue Aug 30 04:33:32 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:33:32.956522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:32.970051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-127fe584-69d2-4c2a-afa3-4febeaa20728 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.232161 Aug 30 04:33:32.970830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 271/570] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:32 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:33.997922 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:33.998596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:34.000657 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=79 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:34.008437 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:34.008990 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:34.009460 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:34.010246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:34.010699 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:34.011123 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:34.176612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:34.186452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4e7fa218-4816-4214-a61c-69ee436a01f0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.193432 Aug 30 04:33:34.187068 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 300/571] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:33 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:35.209474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:35.210252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:35.217879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:35.218383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:35.218818 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:35.219546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:35.220019 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:35.220457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:35.408089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:35.419429 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e48bdb77-9b7a-4afb-9bc2-d09eaf84fe35 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.214414 Aug 30 04:33:35.420059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 272/572] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:35 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:36.441606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:36.442426 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:36.452727 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.453554 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.454301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.455600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.456466 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.457234 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.617873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:36.635022 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7a0e77e4-2b63-4342-9035-64faa1f2e7ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.197293 Aug 30 04:33:36.636994 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 301/573] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:36 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:36.956095 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:36.960119 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.960804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.961328 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.976826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.977496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.978000 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.993688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-33b58aa8-a207-46b2-9c3d-8c89f1ad88c3 req-4f4b21f2-7cbd-4ecb-805b-e3269b1729d3 admin admin] 10.222.0.83 "DELETE /compute/v2.1/os-assisted-volume-snapshots/cbfdaaab-0667-459f-a5ca-e3659ba1815a?delete_info=%7B%22file_to_merge%22:%20%22volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.cbfdaaab-0667-459f-a5ca-e3659ba1815a.vhdx%22,%20%22volume_id%22:%20%228d6029e5-b7bc-48cf-a02c-c9812ddcea9d%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.099755 Aug 30 04:33:36.994280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 273/574] 10.222.0.83 () {62 vars in 1800 bytes} [Tue Aug 30 04:33:36 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/cbfdaaab-0667-459f-a5ca-e3659ba1815a?delete_info=%7B%22file_to_merge%22:%20%22volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.cbfdaaab-0667-459f-a5ca-e3659ba1815a.vhdx%22,%20%22volume_id%22:%20%228d6029e5-b7bc-48cf-a02c-c9812ddcea9d%22%7D => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:37.671805 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:37.672508 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:37.680956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:37.681498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:37.682264 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:37.683417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:37.684011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:37.684442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:37.859185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:37.869511 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e6945ed2-1a05-4c34-8ff8-23e07549eaf1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.203307 Aug 30 04:33:37.870103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 302/575] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:37 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:38.892579 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:38.893228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:38.900403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.900896 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.901327 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:38.902014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.902483 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.902873 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:39.097138 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:39.107003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ab823ceb-0ef5-4d7a-8b5f-5f67eb2f850d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.219352 Aug 30 04:33:39.107599 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 274/576] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:38 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:40.141945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:40.142630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:40.150828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:40.151123 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:40.151525 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:40.152384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:40.152873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:40.153315 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:40.313556 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:40.331048 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-94542e41-ff73-4cc5-a552-a60b07b15fe0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.192872 Aug 30 04:33:40.332134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 303/577] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:40 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:41.262255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:41.265843 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.266326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.266779 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.277741 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.278265 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.278681 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.295377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-11ab97bf-7c4f-4b94-9520-e7d2ca0ffc00 req-377cede4-ca00-444f-b749-cbe0c9955b9b admin admin] 10.222.0.83 "DELETE /compute/v2.1/os-assisted-volume-snapshots/e2d1056e-2042-4485-a696-10cf4aed4d04?delete_info=%7B%22file_to_merge%22:%20%22volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.e2d1056e-2042-4485-a696-10cf4aed4d04.vhdx%22,%20%22volume_id%22:%20%228d6029e5-b7bc-48cf-a02c-c9812ddcea9d%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.109714 Aug 30 04:33:41.296255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 275/578] 10.222.0.83 () {62 vars in 1800 bytes} [Tue Aug 30 04:33:41 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/e2d1056e-2042-4485-a696-10cf4aed4d04?delete_info=%7B%22file_to_merge%22:%20%22volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.e2d1056e-2042-4485-a696-10cf4aed4d04.vhdx%22,%20%22volume_id%22:%20%228d6029e5-b7bc-48cf-a02c-c9812ddcea9d%22%7D => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:33:41.372259 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:41.373698 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:41.386020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.386883 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.387688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.389050 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.389833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.390543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.581427 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:41.590994 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-772a5713-91d0-4e4f-9271-7d5cba581885 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.227410 Aug 30 04:33:41.591620 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 304/579] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:41 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:42.614303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:42.615116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:42.623795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:42.624704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:42.625573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:42.626852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:42.627674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:42.628499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:42.806976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:42.816478 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-65085f76-e25f-4ada-b0e9-7af695039071 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.206988 Aug 30 04:33:42.817317 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 276/580] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:42 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:43.839054 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:43.839946 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:43.842842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:43.850613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:43.851372 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:43.852017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:43.852928 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:43.853479 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:43.854255 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:44.008402 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:44.010885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:44.020147 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-da853ae1-a0df-469f-bcb7-f3553b3e3969 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.185366 Aug 30 04:33:44.020934 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 305/581] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:43 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:45.045819 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:45.046552 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:45.049381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=42 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:45.056026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.056620 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.057230 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.058015 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.058515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.058978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.255155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:45.267801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-608697e8-83f9-4f7f-84ba-f0356c386532 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.226100 Aug 30 04:33:45.268615 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 277/582] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:45 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:45.488112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:45.491881 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.492437 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.492871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.502292 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.502781 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.503214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.519657 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-4bdc2cd7-f4a8-4ab2-b8ec-4510fdd83403 req-04abd337-7517-48dc-9aef-86fbeb0c11a2 admin admin] 10.222.0.83 "DELETE /compute/v2.1/os-assisted-volume-snapshots/a13e53ae-0189-431c-8f11-dfbded9dcd5b?delete_info=%7B%22file_to_merge%22:%20%22volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.a13e53ae-0189-431c-8f11-dfbded9dcd5b.vhdx%22,%20%22volume_id%22:%20%228d6029e5-b7bc-48cf-a02c-c9812ddcea9d%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.102398 Aug 30 04:33:45.520494 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 306/583] 10.222.0.83 () {62 vars in 1800 bytes} [Tue Aug 30 04:33:45 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/a13e53ae-0189-431c-8f11-dfbded9dcd5b?delete_info=%7B%22file_to_merge%22:%20%22volume-8d6029e5-b7bc-48cf-a02c-c9812ddcea9d.a13e53ae-0189-431c-8f11-dfbded9dcd5b.vhdx%22,%20%22volume_id%22:%20%228d6029e5-b7bc-48cf-a02c-c9812ddcea9d%22%7D => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:46.293726 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:46.295024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:46.305089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:46.305570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:46.306284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:46.307169 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:46.308455 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:46.308455 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:46.328144 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:46.480170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:46.495770 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cc9a28a0-02c9-4700-99da-e0f028187a7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.206067 Aug 30 04:33:46.496874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 278/584] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:46 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:47.528435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:47.529032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:47.536880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.537374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.538179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.538918 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.539370 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.539792 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.724417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:47.734156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-880ca658-0108-4444-94a9-35be52077328 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.210079 Aug 30 04:33:47.734751 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 307/585] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:47 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:48.758209 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:48.759294 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:48.768122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.768617 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.769044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.769774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.770225 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.770680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.940128 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:48.950896 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-77308222-9507-4c87-9aeb-3d2bfb4c8ea7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.196656 Aug 30 04:33:48.951649 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 279/586] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:48 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:49.974173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:49.975035 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:49.982348 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:49.982848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:49.983306 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:49.984086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:49.984542 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:49.984973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.149654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:50.164806 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5fe15bbd-c4f6-4724-bffe-d6e2488eaab9 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1734 microversion: 2.1 time: 0.194647 Aug 30 04:33:50.166332 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 308/587] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:49 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:50.457222 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:50.458197 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:50.466103 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:50.466599 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:50.467049 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.467750 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:50.468238 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:50.468658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.653042 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lazy-loading 'services' on Instance uuid 95a63575-5a38-460c-9d5b-5184d01154cb {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:50.783587 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cbe68e31-9808-485e-9862-ffc929e305f5 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "DELETE /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb/os-volume_attachments/8d6029e5-b7bc-48cf-a02c-c9812ddcea9d" status: 202 len: 0 microversion: 2.1 time: 0.330559 Aug 30 04:33:50.788439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 280/588] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:33:50 2022] DELETE /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb/os-volume_attachments/8d6029e5-b7bc-48cf-a02c-c9812ddcea9d => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:51.193261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:51.194211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:51.202428 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.203043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.203619 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.204583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.205090 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.205571 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.396070 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:51.407296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-97202226-bae7-45ff-9e12-71e94b02b615 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1714 microversion: 2.1 time: 0.218613 Aug 30 04:33:51.407958 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 309/589] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:51 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1714 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:51.570723 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=6 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:51.580448 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:51.581420 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:51.599088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.599998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.600817 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.602150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.602966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.603732 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.724751 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] HTTP exception thrown: Cannot 'detach_volume' instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 while it is in vm_state rescued Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Request method failure captured: Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: DELETE /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments/0c93eb6b-cfe5-42e8-85fa-822cf2dba852 HTTP/1.1 Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI5wHVu63y0quaUniqRTR3Rdq3_hKasNXmOKcEjaFEPRz2Q6YV9t3NY4sLsy63qIsgRroIX5HqT2kuff3-AzB400MVTV919FNDOQso0tdigaOajD1MR1Coxjek0embcSMpp6HC91cX_nnjwfXU1h8FkL2oaltPTQuUPtBh1n9Su2tc Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:33:51.726482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 589bd91dbf434099b15ed7a8680f93bb Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:33:51.729051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Cannot 'detach_volume' instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 while it is in vm_state rescued Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'server_id': 'a6eea27d-ad1c-4c9e-9da5-a95042f47304', 'id': '0c93eb6b-cfe5-42e8-85fa-822cf2dba852'} Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:51.730424 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 while it is in vm_state rescued Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 while it is in vm_state rescued Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:33:51.733403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Returning 409 to user: Cannot 'detach_volume' instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 while it is in vm_state rescued {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:51.735808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0e589c42-a279-4792-bf9d-ab5a819eb05f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments/0c93eb6b-cfe5-42e8-85fa-822cf2dba852" status: 409 len: 152 microversion: 2.1 time: 0.159230 Aug 30 04:33:51.735808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 281/590] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:33:51 2022] DELETE /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments/0c93eb6b-cfe5-42e8-85fa-822cf2dba852 => generated 152 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:33:51.738671 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:51.739615 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:51.747711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.748539 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.750682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.750682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.750682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.750682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.831183 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4527a880-e88d-4a46-8bb1-1105d68d8d2f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "POST /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/action" status: 202 len: 0 microversion: 2.1 time: 0.097153 Aug 30 04:33:51.831739 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 310/591] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:51 2022] POST /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:51.842562 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:51.843190 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:51.850227 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.850721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.851153 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.851874 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.852699 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.852877 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.149355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:52.167169 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-70e5d8a4-2d78-4e1a-bdd2-1f8daaff52c6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.329300 Aug 30 04:33:52.168106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 282/592] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:51 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:53.056384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:53.057249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:53.068959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.069845 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.070630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.071878 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.072746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.073503 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.106670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:53.203544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:53.204840 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:53.209628 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-301c1b5c-f2bc-4ec4-b1b6-85b74c206287 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "DELETE /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 204 len: 0 microversion: 2.1 time: 0.159052 Aug 30 04:33:53.212041 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 311/593] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:53 2022] DELETE /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:53.213811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.214504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.215051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.215853 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.216524 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.217096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.230481 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:53.232332 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:53.243889 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.244724 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.245497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.246780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.247543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.248327 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.406208 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:53.431744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-981c53a0-ce36-4a26-8aca-a3a3d1b16dd6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.235417 Aug 30 04:33:53.432759 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 283/594] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:53 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:53.470266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:53.479131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2d4dace0-5bbe-4f90-ac30-70ea6a440541 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.260195 Aug 30 04:33:53.479729 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 312/595] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:53 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:54.454887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:54.455943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:54.463390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:54.464053 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:54.464764 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:54.465741 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:54.466379 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:54.466955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:54.506312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:54.507263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:54.514978 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:54.515455 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:54.515880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:54.516599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:54.517060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:54.517476 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:54.664802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:54.673925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0c9a9149-2418-483a-982d-ddbb4c80b843 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.223248 Aug 30 04:33:54.674794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 284/596] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:54 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:54.685231 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:54.700559 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d2036876-66a2-489c-87c5-92b15d46b2e1 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.201288 Aug 30 04:33:54.701568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 313/597] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:54 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:55.697826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:55.698457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:55.706188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.706859 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.707335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.708466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.709121 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.709723 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.736590 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:55.737625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:55.741091 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:55.750653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.751509 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.752304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.753604 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.754389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.755290 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.902642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:55.918727 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4a210d48-0052-4802-8fe5-107848ea2fbc tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.224856 Aug 30 04:33:55.920078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 285/598] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:55 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:55.941424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:55.950456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-137035a3-2cb2-49cb-9c51-6d2f9596e298 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.219264 Aug 30 04:33:55.951115 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 314/599] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:55 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:56.953753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:56.954427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:56.962004 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:56.962492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:56.962922 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:56.963652 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:56.964147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:56.964566 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:56.979400 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:56.980616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:56.988744 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:56.989991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:56.990715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:56.991627 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:56.992282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:56.992763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.144921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:57.156523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f541bef0-a90a-4d3f-89ed-2f00d3c05aaa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.206921 Aug 30 04:33:57.157107 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 286/600] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:56 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:57.207139 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:57.216513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e873cf5f-0c49-495a-b6ad-4519bcbd6690 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.243055 Aug 30 04:33:57.217301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 315/601] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:56 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:58.181229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:58.181955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:58.189595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:58.190084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:58.190513 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:58.191252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:58.191714 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:58.192374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:58.238764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:58.240178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:58.247244 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:58.247711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:58.248190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:58.248938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:58.249386 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:58.249807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:58.375641 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:58.386585 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-421d45d9-4d48-4a09-8f23-b9b8a3e3b45c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.209376 Aug 30 04:33:58.387535 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 287/602] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:58 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:58.429869 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:58.444852 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c9dabc96-8d1c-4a4e-aab2-8b8fd798b1a4 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.209530 Aug 30 04:33:58.445742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 316/603] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:58 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:59.411315 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:59.413029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:59.420637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.421136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.421569 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.422293 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.422748 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.423167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.482889 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:59.484028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:59.493359 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.493857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.494295 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.495015 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.495472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.495903 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.627238 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:59.642310 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-908264e4-1c52-436b-8643-f224f9bb1af5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.235307 Aug 30 04:33:59.646646 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 288/604] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:59 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:59.680016 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:59.693917 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1e5d310b-2580-4348-b9de-a0d1eb62f571 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.218053 Aug 30 04:33:59.694941 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 317/605] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:59 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:00.667583 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:00.668329 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:00.675389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:00.675868 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:00.676325 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:00.677161 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:00.677607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:00.678022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:00.729561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:00.730662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:00.743259 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:00.744199 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:00.745418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:00.746737 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:00.747550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:00.748388 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:00.871214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:00.883731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7bcbfc54-dd93-4e8c-9edf-fb1309e70adb tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1722 microversion: 2.1 time: 0.220213 Aug 30 04:34:00.884966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 289/606] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:00 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:00.934202 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:00.943380 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6be4c602-7475-4797-81bc-76fffa8b0c49 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.219596 Aug 30 04:34:00.944019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 318/607] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:00 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:01.909525 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:01.910169 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:01.918084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.918632 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.919194 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:01.919949 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.920529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.920980 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:01.969167 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:01.970344 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:01.979299 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.979500 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.979807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:01.980580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.981050 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.981477 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:02.121567 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:02.137416 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4568beb6-f359-444c-aefa-a55612004e8d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1728 microversion: 2.1 time: 0.231877 Aug 30 04:34:02.138698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 290/608] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:01 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:02.157078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:02.166503 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9d21a96c-15f0-4e29-b863-56554f010735 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.204607 Aug 30 04:34:02.167367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 319/609] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:01 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:02.171937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:02.172423 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:02.180148 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:02.180811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:02.181346 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:02.182208 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:02.182745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:02.183250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:02.280364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-384883e0-302d-4eb8-9f9f-fc9a7d78cdbd tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111936 Aug 30 04:34:02.281437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 291/610] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:34:02 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:03.194198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:03.195256 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:03.207243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:03.208136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:03.209724 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:03.211043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:03.211857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:03.212674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:03.234615 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:03.435994 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:03.451237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3acd5187-d96c-4b44-8f7f-c2672770dec0 tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1512 microversion: 2.1 time: 0.265315 Aug 30 04:34:03.452972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 320/611] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:03 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:03.891683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:03.893929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:03.902313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:03.902993 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:03.903521 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:03.904441 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:03.905079 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:03.905600 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:03.948463 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-e7fc5be4-98e3-49c3-8842-7d2f393c1556 req-e7900e84-06fb-434c-b569-0a43dc0528c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a63575-5a38-460c-9d5b-5184d01154cb", "name": "network-vif-deleted", "tag": "2665e87c-c423-4535-b82a-5a19d9770e58"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:04.000679 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e7fc5be4-98e3-49c3-8842-7d2f393c1556 req-e7900e84-06fb-434c-b569-0a43dc0528c9 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.004690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e7fc5be4-98e3-49c3-8842-7d2f393c1556 req-e7900e84-06fb-434c-b569-0a43dc0528c9 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.007944 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-e7fc5be4-98e3-49c3-8842-7d2f393c1556 req-e7900e84-06fb-434c-b569-0a43dc0528c9 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.030986 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d4dfc13c-5f6e-4f7d-a3d4-cbd29733a9fe tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/action" status: 202 len: 0 microversion: 2.1 time: 0.144023 Aug 30 04:34:04.031483 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-e7fc5be4-98e3-49c3-8842-7d2f393c1556 req-e7900e84-06fb-434c-b569-0a43dc0528c9 service nova] Creating event network-vif-deleted:2665e87c-c423-4535-b82a-5a19d9770e58 for instance 95a63575-5a38-460c-9d5b-5184d01154cb on hv-cinder-85426 Aug 30 04:34:04.038544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 292/612] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:34:03 2022] POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:04.043470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-e7fc5be4-98e3-49c3-8842-7d2f393c1556 req-e7900e84-06fb-434c-b569-0a43dc0528c9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105108 Aug 30 04:34:04.046620 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:04.047337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:04.058790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 321/613] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:04.059674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.060212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.060648 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.061400 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.062372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.062372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.265565 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:04.275877 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:04.282865 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c281a153-6040-4bf4-88e7-9116ece4d66d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1752 microversion: 2.1 time: 0.241138 Aug 30 04:34:04.283727 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 293/614] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:04 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1752 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:04.483453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:04.485155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:04.492092 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:04.495376 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.496222 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.496874 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.497821 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.498275 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.499086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.539548 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.540419 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.541091 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.541771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lazy-loading 'fault' on Instance uuid 95a63575-5a38-460c-9d5b-5184d01154cb {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:04.595802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f237249974584d938baf71727ea3a162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9322fbe1939b46c3aee2418884f81e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:04.605561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0b5aff28-0709-424c-8cd8-ece4a32e7b6e tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 200 len: 1308 microversion: 2.1 time: 0.126323 Aug 30 04:34:04.606172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 322/615] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:04 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:05.307096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:05.307955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:05.315929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:05.316927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:05.318926 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:05.319944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:05.320591 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:05.321167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:05.579207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:05.589863 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b5f449ae-a735-4dcd-92d5-0b7a19b5959d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1752 microversion: 2.1 time: 0.287891 Aug 30 04:34:05.590480 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 294/616] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:05 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1752 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:05.641533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:05.642659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] [instance: 95a63575-5a38-460c-9d5b-5184d01154cb] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:05.655655 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:05.656534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:05.657333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:05.658594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:05.659403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:05.660204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:05.687217 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] HTTP exception thrown: Instance 95a63575-5a38-460c-9d5b-5184d01154cb could not be found. Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Request method failure captured: Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb HTTP/1.1 Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZJ49yC62be8Kn6_EEFOHGlPgr0Tou0RO2nZpVfdpjoT8CstEQGbquJ7jEoSkD7Ma9YoheWoIO_YblhNncmJ3pBx8EkWqLCyOkClAeFcybVprP9hvpAASs1bEzq4XrdGo7AGHp2Cnux0JWKcNzk63kSfpKeYI6z4xDCTmxiFjSSfjwo Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: 9322fbe1939b46c3aee2418884f81e9a Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1056740558 Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:34:05.690432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9322fbe1939b46c3aee2418884f81e9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesSnapshotTestJSON-1056740558 Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: 9322fbe1939b46c3aee2418884f81e9a Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1056740558 Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesSnapshotTestJSON-1056740558-project Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: f237249974584d938baf71727ea3a162 Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesSnapshotTestJSON-1056740558-project Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 95a63575-5a38-460c-9d5b-5184d01154cb could not be found. Aug 30 04:34:05.692902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '95a63575-5a38-460c-9d5b-5184d01154cb'} Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a63575-5a38-460c-9d5b-5184d01154cb could not be found. Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:05.693649 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a63575-5a38-460c-9d5b-5184d01154cb could not be found. Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a63575-5a38-460c-9d5b-5184d01154cb could not be found. Aug 30 04:34:05.695279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:05.696679 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] Returning 404 to user: Instance 95a63575-5a38-460c-9d5b-5184d01154cb could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:05.702380 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bb29537a-1b6a-4dc2-afe8-a7dc5012dc2f tempest-VolumesSnapshotTestJSON-1056740558 tempest-VolumesSnapshotTestJSON-1056740558-project] 10.222.0.91 "GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb" status: 404 len: 111 microversion: 2.1 time: 0.059106 Aug 30 04:34:05.703537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 323/617] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:05 2022] GET /compute/v2.1/servers/95a63575-5a38-460c-9d5b-5184d01154cb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:06.075950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-5abca3c1-39fb-4083-93a8-b965bcf660b2 req-e0c39b73-9936-46f0-b3f2-dfb4ab316a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6eea27d-ad1c-4c9e-9da5-a95042f47304", "tag": "8cae059a-7b2c-4abb-9d46-5df4d36ea2ef"}, {"name": "network-changed", "server_uuid": "a6eea27d-ad1c-4c9e-9da5-a95042f47304", "tag": "8cae059a-7b2c-4abb-9d46-5df4d36ea2ef"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:06.092667 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5abca3c1-39fb-4083-93a8-b965bcf660b2 req-e0c39b73-9936-46f0-b3f2-dfb4ab316a99 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:06.093541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5abca3c1-39fb-4083-93a8-b965bcf660b2 req-e0c39b73-9936-46f0-b3f2-dfb4ab316a99 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:06.094319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5abca3c1-39fb-4083-93a8-b965bcf660b2 req-e0c39b73-9936-46f0-b3f2-dfb4ab316a99 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:06.118850 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-5abca3c1-39fb-4083-93a8-b965bcf660b2 req-e0c39b73-9936-46f0-b3f2-dfb4ab316a99 service nova] Creating event network-changed:8cae059a-7b2c-4abb-9d46-5df4d36ea2ef for instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 on hv-cinder-85426 Aug 30 04:34:06.119761 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-5abca3c1-39fb-4083-93a8-b965bcf660b2 req-e0c39b73-9936-46f0-b3f2-dfb4ab316a99 service nova] Creating event network-changed:8cae059a-7b2c-4abb-9d46-5df4d36ea2ef for instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 on hv-cinder-85426 Aug 30 04:34:06.130640 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-5abca3c1-39fb-4083-93a8-b965bcf660b2 req-e0c39b73-9936-46f0-b3f2-dfb4ab316a99 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060696 Aug 30 04:34:06.134639 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 295/618] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:06.612765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:06.613389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:06.621028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:06.621576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:06.622007 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:06.622750 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:06.623219 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:06.623651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:06.798178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:06.807890 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-21b33d66-6033-428a-b745-663c05c654bf tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.199052 Aug 30 04:34:06.808508 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 324/619] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:06 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:07.834621 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:07.835315 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:07.843454 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:07.844034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:07.844517 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:07.845241 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:07.845697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:07.846119 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:08.038323 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:08.047724 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d64a7a2c-8a81-47d0-a961-d62812fbe0f5 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.218182 Aug 30 04:34:08.048343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 296/620] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:07 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:09.074767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:09.075565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:09.087815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:09.088574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:09.089187 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:09.090281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:09.090894 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:09.091535 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:09.301389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:09.311135 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-53243051-3611-424b-9063-2c164de2baed tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.243975 Aug 30 04:34:09.311712 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 325/621] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:09 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:10.349514 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:10.350281 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:10.359407 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:10.360182 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:10.360620 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:10.361438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:10.361891 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:10.362321 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:10.552453 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:10.568704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-de36ae46-2f77-4fa0-90ce-7a1b8b8a8557 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.228988 Aug 30 04:34:10.569954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 297/622] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:10 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:10.873053 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:10.875848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:10.884036 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:10.884534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:10.884973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:10.885693 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:10.886244 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:10.886686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:10.922913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f48dd16e-39f0-4588-88f5-82c910e6363e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054154 Aug 30 04:34:10.923484 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 326/623] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:10 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:34:11.032642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:11.033191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:11.040814 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.041455 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.041943 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.042848 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.043425 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.043901 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.075820 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:11.170661 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1d343bca-6cf7-4291-8609-763971bbdfe7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 204 len: 0 microversion: 2.1 time: 0.142131 Aug 30 04:34:11.171249 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 298/624] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:11 2022] DELETE /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:11.182562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:11.183496 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:11.191624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.192694 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.193363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.194476 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.195233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.196037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.412461 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:11.422228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-982cfc80-ea41-4c51-8453-f611d25643b3 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1673 microversion: 2.1 time: 0.244022 Aug 30 04:34:11.422752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 327/625] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:11 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:11.592821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:11.593576 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:11.600852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.601296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.601728 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.602455 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.602896 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.603309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.771047 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:11.780713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5fd0c79c-d6e6-4f28-9171-c12122130486 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.193179 Aug 30 04:34:11.781379 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 299/626] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:11 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:12.445163 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:12.445811 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:12.453181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:12.453911 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:12.454344 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:12.455041 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:12.455480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:12.455980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:12.611797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:12.625578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-300ac0d9-9459-4028-8758-e16c1a64f172 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1673 microversion: 2.1 time: 0.184152 Aug 30 04:34:12.626641 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 328/627] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:12 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:12.808398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:12.810975 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:12.822827 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:12.824175 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:12.824934 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:12.826240 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:12.827050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:12.827816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:13.058785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:13.070070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e24f69ab-4e59-4a06-a73d-224d85923997 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.269104 Aug 30 04:34:13.070817 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 300/628] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:12 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:13.654228 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:13.655077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:13.662621 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:13.663482 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:13.663948 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:13.664674 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:13.665131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:13.665556 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:13.914501 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:13.923907 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c2ce049d-4b1d-4df0-a3e5-ba1b0257a195 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1673 microversion: 2.1 time: 0.274701 Aug 30 04:34:13.924697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 329/629] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:13 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1673 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:14.098384 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:14.099779 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:14.113309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.115610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.116530 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:14.118220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.119453 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.120544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:14.606157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:14.615871 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-61fdc5e6-eddd-4be4-8ca0-ecdc74c8c2fb tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.524259 Aug 30 04:34:14.628229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 301/630] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:14 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:14.948918 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:14.949667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:14.960522 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.961386 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.962158 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:14.963442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.964267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.965146 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:15.087552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:15.103110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-deb99ac0-ceb5-4011-8784-0c8ee282af1b tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1606 microversion: 2.1 time: 0.159950 Aug 30 04:34:15.104196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 330/631] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:14 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1606 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:15.412445 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-b839f5e3-3549-4e7d-bc37-600c55448487 req-28234c45-8dc3-4446-9c8a-665d845f6bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a566046-e7ae-47bc-bba8-3875c0ef4fa9", "name": "network-vif-deleted", "tag": "a074f768-02bd-44f4-a577-4d4aee4c169b"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:15.418729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:15.434426 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b839f5e3-3549-4e7d-bc37-600c55448487 req-28234c45-8dc3-4446-9c8a-665d845f6bce service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:15.435266 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b839f5e3-3549-4e7d-bc37-600c55448487 req-28234c45-8dc3-4446-9c8a-665d845f6bce service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:15.435689 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b839f5e3-3549-4e7d-bc37-600c55448487 req-28234c45-8dc3-4446-9c8a-665d845f6bce service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:15.450302 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-b839f5e3-3549-4e7d-bc37-600c55448487 req-28234c45-8dc3-4446-9c8a-665d845f6bce service nova] Creating event network-vif-deleted:a074f768-02bd-44f4-a577-4d4aee4c169b for instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 on hv-cinder-85426 Aug 30 04:34:15.456024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-b839f5e3-3549-4e7d-bc37-600c55448487 req-28234c45-8dc3-4446-9c8a-665d845f6bce service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048453 Aug 30 04:34:15.456905 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 302/632] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:15.653079 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:15.654195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:15.669364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:15.670809 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:15.671959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:15.673185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:15.673925 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:15.674506 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.028174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:16.055273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-32efb94a-6404-49cf-8e4e-a6d3cdea5e99 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.407358 Aug 30 04:34:16.056374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 331/633] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:15 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:16.144725 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:16.147089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:16.164577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.166075 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.167218 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.169033 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.170254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.171291 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.241774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.242526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.243059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.243620 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lazy-loading 'fault' on Instance uuid 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:16.323244 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:16.338749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-433fc36b-ef64-4397-9ac8-3eb850c7a5a0 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 200 len: 1328 microversion: 2.1 time: 0.204746 Aug 30 04:34:16.339675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 303/634] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:16 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 1328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:17.085384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:17.087421 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:17.100771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:17.101691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:17.102471 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:17.103759 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:17.104653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:17.105415 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:17.366807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:17.377970 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:17.378991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-48999a7e-7f31-41e8-8ab3-e53ff7d35209 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.301716 Aug 30 04:34:17.379205 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:17.383978 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 332/635] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:17 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:17.391091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:17.391959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:17.392696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:17.394044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:17.394846 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:17.395645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:17.423188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] HTTP exception thrown: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Request method failure captured: Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 HTTP/1.1 Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI6JUiaoREI_8V36tCbgjztSk1aIRMyKtcsoKo6bBl_OM5D8QQY58ZVaC9YAuojDkNp1FprMPFFI5yU1GmfDnl0iQpB84V_QbndUoJjKqbV6yivRwDqoCiCGiH7vhOnfvH2gkSGIWeoDve6xZrIDrTlSnV7Oyt2p813atr_KTk0ZZg Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:34:17.426458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 9a872454622d41ce9462890af418182d Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:34:17.429881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '9a566046-e7ae-47bc-bba8-3875c0ef4fa9'} Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:17.431337 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:34:17.433813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.436372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Returning 404 to user: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:17.436372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f36eb1e5-6cd1-42e1-a4e4-2f563914834c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 404 len: 111 microversion: 2.1 time: 0.057947 Aug 30 04:34:17.436372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 304/636] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:17 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:17.445703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-abf9cc85-e4cf-4414-9b50-5084f4d864bd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '.version_select at 0x7f24ec4ddc10>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:17.479595 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-abf9cc85-e4cf-4414-9b50-5084f4d864bd tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217156936" status: 202 len: 0 microversion: 2.1 time: 0.041519 Aug 30 04:34:17.480648 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 333/637] 10.222.0.91 () {58 vars in 1221 bytes} [Tue Aug 30 04:34:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217156936 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:18.319048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-383f4112-6b87-4f38-8736-9500484e8029 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'create', calling method: .version_select at 0x7f24ec54a700>, body: {"keypair": {"name": "tempest-keypair-74073869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH23gQin/8X/a2Csd4nDcBH3KO+UDLY3/Sl2dmGhTq4F34ojfdhraSn0yQ1mDj3+TZVX2Lu/GRcbH0I9+qVaDJf6jTuiq4ms1FN92+AVvB637QS2n7F8vPm6Loo01Ve7zA=="}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:18.347106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-383f4112-6b87-4f38-8736-9500484e8029 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:18.356864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-383f4112-6b87-4f38-8736-9500484e8029 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for user 9a872454622d41ce9462890af418182d and project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:18.396996 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-383f4112-6b87-4f38-8736-9500484e8029 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.085601 Aug 30 04:34:18.397886 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 305/638] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:34:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:18.409853 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:18.411127 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:18.424213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:18.424991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:18.425764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:18.427168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:18.428023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:18.428970 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:18.696104 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:18.707019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f7da821f-2047-47c5-847c-acc8016e77ea tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.304091 Aug 30 04:34:18.707616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 334/639] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:18 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:19.483927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:19.484859 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:19.493795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.494578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.495208 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.496155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.496868 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.497502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.540737 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c5e9f344-f87f-44b2-860b-1da50a1ccc7b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments/d6aba952-3969-4b75-aa1b-2205253f38dd" status: 200 len: 194 microversion: 2.20 time: 0.072717 Aug 30 04:34:19.552633 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 306/640] 10.222.0.91 () {60 vars in 1454 bytes} [Tue Aug 30 04:34:19 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments/d6aba952-3969-4b75-aa1b-2205253f38dd => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:34:19.652602 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:19.653374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:19.663393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.663960 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.664651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.665405 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.665871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.666381 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.732965 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:19.734287 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:19.746310 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.748048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.749708 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.751938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.752946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.753627 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.788471 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lazy-loading 'services' on Instance uuid 72691437-a322-4abe-a51d-6883e8aa8717 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:19.898732 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9a4c76da-384d-4381-bd7a-9cec64961ad1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments/d6aba952-3969-4b75-aa1b-2205253f38dd" status: 202 len: 0 microversion: 2.20 time: 0.258708 Aug 30 04:34:19.899650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 335/641] 10.222.0.91 () {60 vars in 1457 bytes} [Tue Aug 30 04:34:19 2022] DELETE /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments/d6aba952-3969-4b75-aa1b-2205253f38dd => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:19.916363 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:19.921904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:19.938417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.939313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.940165 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.941827 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.943177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.944564 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.009678 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f724ea49-afe6-4484-b662-8d0fdc47e84e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104247 Aug 30 04:34:20.011098 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 336/642] 10.222.0.91 () {60 vars in 1343 bytes} [Tue Aug 30 04:34:19 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:34:20.073254 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:20.087602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cc2fd615-383e-437f-a8f3-b2b62f7bb12e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.361854 Aug 30 04:34:20.088545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 307/643] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:19 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:20.357876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1418418460", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bddd7440-d2d5-43f3-9351-36f5944c255c"}], "security_groups": [{"name": "tempest-securitygroup--666260532"}], "key_name": "tempest-keypair-74073869", "user_data": "}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:20.486680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] validate_networks() for [('bddd7440-d2d5-43f3-9351-36f5944c255c', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:34:20.775422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:20.777006 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:20.785304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.785855 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.789083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.789083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.789083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.789600 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.829397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-dd04a408-5b03-47e4-b9b4-3b47e4769ba6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a/ips" status: 200 len: 150 microversion: 2.1 time: 0.059578 Aug 30 04:34:20.830497 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 308/644] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:34:20 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:20.852835 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:20.858382 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:20.870120 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.871198 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.872076 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.873181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.874430 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.875256 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.001803 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Invalid volume: volume 8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f is already attached to instances: fe95c6ff-83ad-4fcd-9d95-59695f830f10 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: POST /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a/os-volume_attachments HTTP/1.1 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 74 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:34:21.003442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {"volumeAttachment": {"volumeId": "8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f"}} Aug 30 04:34:21.005300 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Invalid volume: volume 8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f is already attached to instances: fe95c6ff-83ad-4fcd-9d95-59695f830f10 Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'server_id': '72a97f79-ee44-4f9c-bd29-4042d2f4bb2a', 'body': {'volumeAttachment': {'volumeId': '8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f'}}} Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f is already attached to instances: fe95c6ff-83ad-4fcd-9d95-59695f830f10 Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:21.006419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f is already attached to instances: fe95c6ff-83ad-4fcd-9d95-59695f830f10 Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:21.008135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f is already attached to instances: fe95c6ff-83ad-4fcd-9d95-59695f830f10 Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 400 to user: Invalid volume: volume 8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f is already attached to instances: fe95c6ff-83ad-4fcd-9d95-59695f830f10 {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2b983ce2-d09f-4527-88f3-481460e721bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161915 Aug 30 04:34:21.009380 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 309/645] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:34:20 2022] POST /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a/os-volume_attachments => generated 174 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:34:21.021032 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.021812 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.030894 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.031391 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.032044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.032857 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.033319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.033721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.068371 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:21.107721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:21.110225 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:21.111258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:21.112602 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:21.114653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:21.115328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:21.135861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.137124 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.137922 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.139590 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.140738 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.141670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.164134 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0aadbedb-47ba-4fea-9834-7c2898edad70 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 204 len: 0 microversion: 2.1 time: 0.148996 Aug 30 04:34:21.165785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 310/646] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:21 2022] DELETE /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:34:21.172006 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.174426 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.181053 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.181534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.182098 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:21.182234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.182825 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.183413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.183741 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.190514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Getting quotas for user 9a872454622d41ce9462890af418182d and project 1638b6f183134b83b87ce6f2eb995d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:21.214951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:21.219509 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:21.222110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-218c12b6-03fc-4ecb-b3ef-f844de0d2f51 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054760 Aug 30 04:34:21.223129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 311/647] 10.222.0.91 () {60 vars in 1343 bytes} [Tue Aug 30 04:34:21 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:21.235593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.239271 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.246059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.247009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.247488 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.248296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.250438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.250980 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.308152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6a020a94-9cb2-490f-9ec0-021dd1942ad5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.954714 Aug 30 04:34:21.315032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 337/648] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:34:21.320717 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.321338 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.338794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.340082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.340993 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.342847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.343648 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.344251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.475658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:21.485930 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-76b6ce67-875b-417b-aeb5-813e235ba61d tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.261253 Aug 30 04:34:21.486549 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 312/649] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:21 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:21.492518 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.493451 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.508104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.509551 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.510876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.512671 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.513467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.514231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.548163 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:21.562794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:21.573554 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ef6674a1-4899-45fd-a37d-d16451f2ea5b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1681 microversion: 2.1 time: 0.257131 Aug 30 04:34:21.578937 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 338/650] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:21 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:21.591885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a41bf5b4-5c9e-4b18-9b7c-1428e24639b1 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.593460 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a41bf5b4-5c9e-4b18-9b7c-1428e24639b1 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.663556 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e14d5e07-92bd-4316-beb8-2c014592a9bb tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 204 len: 0 microversion: 2.20 time: 0.174523 Aug 30 04:34:21.665379 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 313/651] 10.222.0.91 () {60 vars in 1280 bytes} [Tue Aug 30 04:34:21 2022] DELETE /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:34:21.678012 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.678427 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a41bf5b4-5c9e-4b18-9b7c-1428e24639b1 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:21.680122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.689092 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a41bf5b4-5c9e-4b18-9b7c-1428e24639b1 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1236 microversion: 2.1 time: 0.107928 Aug 30 04:34:21.690033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 339/652] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:21 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1236 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:21.695333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.696048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.696554 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.697268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.697780 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.698194 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.927820 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:21.940849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:21.943211 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:21.949214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-87f3e1f8-4116-4caf-9c74-ac7d92ec9665 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.274774 Aug 30 04:34:21.959743 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 314/653] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:21 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:22.512163 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:22.513071 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:22.521944 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.522465 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.522894 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.523617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.524102 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.524534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.530321 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:22.600583 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:22.601365 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:22.625471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.626191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.627260 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.627673 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.628314 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.629052 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.737575 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:22.747767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ae45b5e8-2782-40e0-8bbf-4b29c56d3369 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1757 microversion: 2.1 time: 0.240075 Aug 30 04:34:22.748811 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 340/654] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:22 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1757 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:22.759369 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:22.760131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:22.767116 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.767603 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.768068 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.768781 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.769237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.769650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.835832 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:22.849802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f14d2628-cd35-46ef-bccf-4677f90304ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1681 microversion: 2.1 time: 0.254400 Aug 30 04:34:22.850117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:22.850776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 315/655] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:22 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:22.859956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0b8d06e7-a197-4373-beab-3f10907aff10 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1240 microversion: 2.1 time: 0.104702 Aug 30 04:34:22.860739 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 341/656] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:22 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:22.975354 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:22.976097 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:22.982544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.983207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.983646 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.984444 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.984835 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.985263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.150175 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.169582 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.172594 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.174713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d888fb4d-df76-4c52-b0e1-98e44f6a8e6e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.203444 Aug 30 04:34:23.175548 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 316/657] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:22 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:23.775704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:23.776425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:23.784432 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.784986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.785632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.786394 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.787287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.787583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.874498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:23.875548 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:23.884566 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.885065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.885503 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.886219 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.886670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.887089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.979329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.991103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-49d4bf7f-c651-42b0-86a5-5a88133ee754 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1760 microversion: 2.1 time: 0.223696 Aug 30 04:34:23.991737 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 342/658] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:23 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1760 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:24.008129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:24.008129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:24.008129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.008129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.009073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.009073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.009073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.009073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.082018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.092700 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f33e6c28-b43a-41ff-a517-220e0dd3f692 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1681 microversion: 2.1 time: 0.222872 Aug 30 04:34:24.093659 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 317/659] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:23 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:24.120130 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.129134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4ea882f3-ac5b-4c07-ad8d-72d9ce649914 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1240 microversion: 2.1 time: 0.136132 Aug 30 04:34:24.129614 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 343/660] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:23 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:24.213403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:24.214286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:24.221112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.221606 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.222027 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.222723 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.223145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.223680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.415431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.427840 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.430124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.431997 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4d0dfa34-64b2-466d-9a2d-84e3a382abf0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.222766 Aug 30 04:34:24.432696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 318/661] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:24 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:25.131896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:25.133057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:25.149145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.150087 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.152370 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.155804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.157078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.157852 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.172645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:25.173839 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:25.188192 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.189579 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.190476 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.191898 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.193317 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.194115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.291346 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:25.300131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-376a75b9-0d0f-4807-a4ed-e53c1290a817 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1232 microversion: 2.1 time: 0.151046 Aug 30 04:34:25.300977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 319/662] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:25 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1232 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:25.385341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:25.397594 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e945f599-4295-4840-9c49-6d8e5e1c7e1f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1681 microversion: 2.1 time: 0.273563 Aug 30 04:34:25.398612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 344/663] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:25 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:25.458145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:25.458766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:25.465545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.466044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.466476 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.467320 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.467767 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.468301 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.109785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.124317 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.127122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.129044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5f2f7925-c69b-44da-8ea8-faf373fc749b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.675450 Aug 30 04:34:26.129925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 320/664] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:25 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:26.337575 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:26.340850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:26.357444 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.358468 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.359658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.361524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.362804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.364026 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.445518 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:26.450055 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:26.467400 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.469092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.477045 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.482237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.484998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.486552 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.492955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.522462 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4d4c2a0c-633a-44dd-95de-352f064b857e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1288 microversion: 2.1 time: 0.189620 Aug 30 04:34:26.524465 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 345/665] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:26 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1288 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:26.545339 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-1328f335-3b1d-42dc-af21-ba615f072067 req-e39f6b13-16d7-4be8-b427-77c889b2f9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "name": "network-vif-unplugged", "status": "completed", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:26.577237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-1328f335-3b1d-42dc-af21-ba615f072067 req-e39f6b13-16d7-4be8-b427-77c889b2f9b1 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.578266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-1328f335-3b1d-42dc-af21-ba615f072067 req-e39f6b13-16d7-4be8-b427-77c889b2f9b1 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.578915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-1328f335-3b1d-42dc-af21-ba615f072067 req-e39f6b13-16d7-4be8-b427-77c889b2f9b1 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.603399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-1328f335-3b1d-42dc-af21-ba615f072067 req-e39f6b13-16d7-4be8-b427-77c889b2f9b1 service nova] Creating event network-vif-unplugged:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:34:26.610875 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-1328f335-3b1d-42dc-af21-ba615f072067 req-e39f6b13-16d7-4be8-b427-77c889b2f9b1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078523 Aug 30 04:34:26.612487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 346/666] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:26.970176 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.001804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-19220e48-bfd1-44fd-980d-a96cf7ae7a08 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1681 microversion: 2.1 time: 0.556796 Aug 30 04:34:27.004647 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 321/667] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:26 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1681 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:27.163585 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:27.165209 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:27.177625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.178899 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.179903 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.181433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.182482 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.184396 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.538714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.553334 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.555879 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.558437 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4e08aafc-9796-4a5d-b124-c6140e6be106 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1723 microversion: 2.20 time: 0.403456 Aug 30 04:34:27.560304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 347/668] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:27 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:27.586335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:27.587259 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:27.599098 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.600556 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.601611 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.603044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.603801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.604575 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.829395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.856911 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-eedca286-064a-4ec6-b419-3a37c1502503 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1294 microversion: 2.1 time: 0.297303 Aug 30 04:34:27.857527 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 322/669] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:27 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1294 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:28.039780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:28.041564 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:28.063580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.064221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.065463 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.066478 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.067119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.068198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.282086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.305860 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3e3e0cf9-b7b4-48b1-aa34-0296d999116d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1614 microversion: 2.1 time: 0.280664 Aug 30 04:34:28.341451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 348/670] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:28 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1614 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:28.463343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-af54da0a-f952-467f-a8c6-e39561b7ee88 req-c3a1af07-30db-4c48-8341-952728a89e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a97f79-ee44-4f9c-bd29-4042d2f4bb2a", "name": "network-vif-deleted", "tag": "dd0eb0ed-dd54-4a61-b759-3c573081c4e6"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:28.473146 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=4 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:28.482384 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-af54da0a-f952-467f-a8c6-e39561b7ee88 req-c3a1af07-30db-4c48-8341-952728a89e79 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.484670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-af54da0a-f952-467f-a8c6-e39561b7ee88 req-c3a1af07-30db-4c48-8341-952728a89e79 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.485242 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-af54da0a-f952-467f-a8c6-e39561b7ee88 req-c3a1af07-30db-4c48-8341-952728a89e79 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.501473 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-af54da0a-f952-467f-a8c6-e39561b7ee88 req-c3a1af07-30db-4c48-8341-952728a89e79 service nova] Creating event network-vif-deleted:dd0eb0ed-dd54-4a61-b759-3c573081c4e6 for instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a on hv-cinder-85426 Aug 30 04:34:28.508895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-af54da0a-f952-467f-a8c6-e39561b7ee88 req-c3a1af07-30db-4c48-8341-952728a89e79 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048863 Aug 30 04:34:28.509710 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 323/671] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:28.586816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:28.588203 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:28.599796 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.612783 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.613551 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.614621 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.615456 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.615887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.732011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.741706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.743193 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.744454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-82aeb6a9-de6e-47b8-8e8c-613605016eed tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1656 microversion: 2.20 time: 0.162205 Aug 30 04:34:28.745029 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 349/672] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:28 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:28.884402 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:28.885527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:28.894750 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-149d1ec2-0f6f-4ca1-adc5-10b728ddc424 req-994a6f0d-f157-49e6-88de-05da175cf386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a97f79-ee44-4f9c-bd29-4042d2f4bb2a", "name": "network-vif-unplugged", "status": "completed", "tag": "dd0eb0ed-dd54-4a61-b759-3c573081c4e6"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:28.930366 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.931239 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.932052 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.933326 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.935766 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.943431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-149d1ec2-0f6f-4ca1-adc5-10b728ddc424 req-994a6f0d-f157-49e6-88de-05da175cf386 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.948988 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.960349 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-149d1ec2-0f6f-4ca1-adc5-10b728ddc424 req-994a6f0d-f157-49e6-88de-05da175cf386 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.961665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-149d1ec2-0f6f-4ca1-adc5-10b728ddc424 req-994a6f0d-f157-49e6-88de-05da175cf386 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.012837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-149d1ec2-0f6f-4ca1-adc5-10b728ddc424 req-994a6f0d-f157-49e6-88de-05da175cf386 service nova] Creating event network-vif-unplugged:dd0eb0ed-dd54-4a61-b759-3c573081c4e6 for instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a on hv-cinder-85426 Aug 30 04:34:29.036229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-149d1ec2-0f6f-4ca1-adc5-10b728ddc424 req-994a6f0d-f157-49e6-88de-05da175cf386 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166662 Aug 30 04:34:29.037742 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 324/673] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:29.092090 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-d401a078-a45b-4852-b535-29f3278ed2c7 req-bee86d72-641d-4ba2-8ef6-03f09bbd974d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999dbbf6-840d-4eb7-ab9e-291b3de143cf", "tag": "b4084b0c-b4e3-4380-b521-ec05e08e1f79"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:29.133496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d401a078-a45b-4852-b535-29f3278ed2c7 req-bee86d72-641d-4ba2-8ef6-03f09bbd974d service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.134914 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d401a078-a45b-4852-b535-29f3278ed2c7 req-bee86d72-641d-4ba2-8ef6-03f09bbd974d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.136193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d401a078-a45b-4852-b535-29f3278ed2c7 req-bee86d72-641d-4ba2-8ef6-03f09bbd974d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.179180 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-d401a078-a45b-4852-b535-29f3278ed2c7 req-bee86d72-641d-4ba2-8ef6-03f09bbd974d service nova] Creating event network-changed:b4084b0c-b4e3-4380-b521-ec05e08e1f79 for instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf on hv-cinder-85426 Aug 30 04:34:29.192954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-d401a078-a45b-4852-b535-29f3278ed2c7 req-bee86d72-641d-4ba2-8ef6-03f09bbd974d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109312 Aug 30 04:34:29.194881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 325/674] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:29.352777 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:29.354677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:29.376994 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.380310 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.385563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.389356 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.392644 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.399068 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.409839 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:29.423753 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-429d24f4-f9b5-40d6-9536-f8c61d671e29 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1361 microversion: 2.1 time: 0.546940 Aug 30 04:34:29.439118 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 350/675] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:28 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:29.478246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.478994 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.480484 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.481696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lazy-loading 'fault' on Instance uuid 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:29.541143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:29.545523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:29.558674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-400e13f6-85c3-4418-bb16-ea8c14cd91bf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 200 len: 1331 microversion: 2.1 time: 0.215037 Aug 30 04:34:29.559731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 326/676] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:29 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 1331 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:29.786374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:29.787758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:29.836387 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.839233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.840854 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.842902 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.843881 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.845191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.943716 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.944635 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.945927 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.947087 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lazy-loading 'fault' on Instance uuid 72691437-a322-4abe-a51d-6883e8aa8717 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:30.032895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:30.056168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:30.059221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:30.061681 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7654a66f-9ee4-42aa-9f61-0b43b76f9721 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 200 len: 1372 microversion: 2.20 time: 0.291927 Aug 30 04:34:30.063250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 351/677] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:29 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 1372 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:30.445885 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:30.446613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:30.457238 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.457864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.458475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.459265 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.459771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.460485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.551206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-090a90c8-2e3c-4a38-8786-49969eacf99d req-a14d6470-5859-45c6-8e2c-20bd203b7086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72691437-a322-4abe-a51d-6883e8aa8717", "name": "network-vif-deleted", "tag": "eaa610dc-af90-4f36-acfa-f6d0db2f74eb"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:30.571210 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-090a90c8-2e3c-4a38-8786-49969eacf99d req-a14d6470-5859-45c6-8e2c-20bd203b7086 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.572157 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-090a90c8-2e3c-4a38-8786-49969eacf99d req-a14d6470-5859-45c6-8e2c-20bd203b7086 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.573515 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-090a90c8-2e3c-4a38-8786-49969eacf99d req-a14d6470-5859-45c6-8e2c-20bd203b7086 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.601062 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-090a90c8-2e3c-4a38-8786-49969eacf99d req-a14d6470-5859-45c6-8e2c-20bd203b7086 service nova] Creating event network-vif-deleted:eaa610dc-af90-4f36-acfa-f6d0db2f74eb for instance 72691437-a322-4abe-a51d-6883e8aa8717 on hv-cinder-85426 Aug 30 04:34:30.610944 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-090a90c8-2e3c-4a38-8786-49969eacf99d req-a14d6470-5859-45c6-8e2c-20bd203b7086 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066563 Aug 30 04:34:30.612313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 352/678] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:30.630847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:30.632332 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:30.642883 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.644125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.644804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.647493 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.647962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.648337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.669572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a HTTP/1.1 Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:34:30.672314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:34:30.674896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '72a97f79-ee44-4f9c-bd29-4042d2f4bb2a'} Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:30.677634 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:34:30.680181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:34:30.682762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:30.682762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-048d5d08-8f02-435a-b63f-56fe363cb1b6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 404 len: 111 microversion: 2.1 time: 0.053647 Aug 30 04:34:30.682762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 353/679] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:30 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:30.683197 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:30.687237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b27a1655-45a1-419f-aa2a-fbe2f1fb97b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '.version_select at 0x7f24ec7398b0>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:30.694622 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0ef9cefb-2dd1-49e3-ac79-2739dd9a1467 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1361 microversion: 2.1 time: 0.253017 Aug 30 04:34:30.695580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 327/680] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:30 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:30.712177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b27a1655-45a1-419f-aa2a-fbe2f1fb97b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096241943" status: 202 len: 0 microversion: 2.1 time: 0.030828 Aug 30 04:34:30.713131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 354/681] 10.222.0.91 () {58 vars in 1221 bytes} [Tue Aug 30 04:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096241943 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:31.100832 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:31.101796 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:31.114056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:31.114924 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:31.115663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:31.116966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:31.118013 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:31.118760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:31.143318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] HTTP exception thrown: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Request method failure captured: Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 HTTP/1.1 Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI0EZ1pZZZdJ3U9njAxwts4vz1IcNWp5ddKw88CdM2GkkVxF14DtAgKnYMyRmcG6gkgR1xwoCTJF1CUeN1RdseRetSBfj3oHC91h-wx5hvugVSHUgsHPVydnPNty5cYZFjoDKrTAuqI0jyvcUVLo04UeTeGoe4bJRbIoq-m6oSX8wM Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:34:31.145080 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/cf24ec2c8bd74974932690a583961691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_cf24ec2c8bd74974932690a583961691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 91067603d9c549278cdc2d97b54cca88 Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:34:31.147815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '72691437-a322-4abe-a51d-6883e8aa8717'} Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:31.149694 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:34:31.151131 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:31.154336 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Returning 404 to user: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:31.154336 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f15bc9e9-bc5c-4dff-ad36-9f18d0e10705 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 404 len: 111 microversion: 2.20 time: 0.054646 Aug 30 04:34:31.154336 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 328/682] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:31 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:34:31.160767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f9baa7fa-0be6-493f-b6de-a677c9304d2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '.version_select at 0x7f24ec4dd820>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:31.167543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:31.187777 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f9baa7fa-0be6-493f-b6de-a677c9304d2b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411464138" status: 204 len: 0 microversion: 2.20 time: 0.033243 Aug 30 04:34:31.188884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 355/683] 10.222.0.91 () {60 vars in 1262 bytes} [Tue Aug 30 04:34:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411464138 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:34:31.726915 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:31.728119 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:31.741759 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:31.743334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:31.744290 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:31.745730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:31.746674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:31.747502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:31.980843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=8 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:31.992189 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:31.993459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:32.006864 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.008421 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.010785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.012543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.013689 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.014809 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.059285 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:32.079608 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6cbb5673-b333-4075-afc7-ce16490fc7ed tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1361 microversion: 2.1 time: 0.360258 Aug 30 04:34:32.092012 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 329/684] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:31 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:32.267546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lazy-loading 'services' on Instance uuid fe95c6ff-83ad-4fcd-9d95-59695f830f10 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:32.420904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-62247875-e6cb-4da1-b7ba-8ec6e38eeb14 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments/8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f" status: 202 len: 0 microversion: 2.1 time: 0.441707 Aug 30 04:34:32.432496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:32.435343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:32.438128 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 356/685] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:34:31 2022] DELETE /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments/8b01e00a-adb9-40f1-baf8-4b6e1edb0c0f => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:32.444888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.445631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.446223 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.447496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.448306 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.448751 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.498326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-701e7360-704f-48f4-8a4a-5703937d3463 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071370 Aug 30 04:34:32.508702 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 330/686] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:32 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:32.553930 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bf446dcc-60c0-44ec-9c76-83a3af6c5766 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'create', calling method: .version_select at 0x7f24ec4dd940>, body: {"keypair": {"name": "tempest-keypair-321207001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHz1Amig6g9YSQg1EQrqcuvQ0z/y9GoerKk4HoMIQBV38PTVoKDLA8lrxdUnimZfdLkjlXRHRjdXmzI7DNroXqftnK1guzzgcxwayQCMYymgPPozXgmRq2lI/2/S9Lh+Q=="}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:32.578518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:32.598146 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-bf446dcc-60c0-44ec-9c76-83a3af6c5766 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for project cf24ec2c8bd74974932690a583961691. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:32.604938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-bf446dcc-60c0-44ec-9c76-83a3af6c5766 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for user 91067603d9c549278cdc2d97b54cca88 and project cf24ec2c8bd74974932690a583961691. Resources: {'key_pairs'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:32.656830 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bf446dcc-60c0-44ec-9c76-83a3af6c5766 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.109733 Aug 30 04:34:32.658391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 357/687] 10.222.0.91 () {62 vars in 1200 bytes} [Tue Aug 30 04:34:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:34:33.104052 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.104936 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.113152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.113639 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.114137 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.115505 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.116206 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.117091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.362173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:33.376807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-058e7950-a51c-4b5d-95bd-7f28bb6bbfe2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1361 microversion: 2.1 time: 0.278326 Aug 30 04:34:33.377346 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 331/688] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:33 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:33.522024 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.528694 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.547200 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.548266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.548951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.550589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.551552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.552639 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.600682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d5013f55-14ae-43f6-ad28-6d50aa398ae4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087778 Aug 30 04:34:33.601816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 358/689] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:33 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:34:33.690846 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.693755 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.705627 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.706796 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.707469 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.708753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.709681 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.710316 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.750712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:33.885050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9f1c250a-1c6c-4bf5-8bd1-24df20cb374b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 204 len: 0 microversion: 2.1 time: 0.200629 Aug 30 04:34:33.887036 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 332/690] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:33 2022] DELETE /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:33.896182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.897076 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.904617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.905219 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.906308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.907570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.908137 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.908722 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.169172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.182021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3682df6a-be9c-4fce-80a0-8daa443361eb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1682 microversion: 2.1 time: 0.290241 Aug 30 04:34:34.182708 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 359/691] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:33 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:34.425475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:34.426718 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:34.451311 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.452649 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.454644 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.455601 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.456408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.458966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.580339 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1177503154", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "169fc8b2-576f-4c43-9cb7-2141fd9da0f6"}], "security_groups": [{"name": "tempest-securitygroup--350809707"}], "key_name": "tempest-keypair-321207001", "user_data": "}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:34.671372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.688204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6d1fbb37-4b15-4989-b2d5-fc447e2f95b2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1361 microversion: 2.1 time: 0.270870 Aug 30 04:34:34.704497 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 333/692] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:34 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:34.717739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-2ee9774d-39d7-4715-9e70-7c9385146c36 req-5bfda7e9-8b02-4cb1-80cb-7ad62bbc3a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999dbbf6-840d-4eb7-ab9e-291b3de143cf", "name": "network-vif-plugged", "status": "completed", "tag": "b4084b0c-b4e3-4380-b521-ec05e08e1f79"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:34.730365 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-2ee9774d-39d7-4715-9e70-7c9385146c36 req-5bfda7e9-8b02-4cb1-80cb-7ad62bbc3a4c service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.731114 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-2ee9774d-39d7-4715-9e70-7c9385146c36 req-5bfda7e9-8b02-4cb1-80cb-7ad62bbc3a4c service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.731738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-2ee9774d-39d7-4715-9e70-7c9385146c36 req-5bfda7e9-8b02-4cb1-80cb-7ad62bbc3a4c service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.739440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] validate_networks() for [('169fc8b2-576f-4c43-9cb7-2141fd9da0f6', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:34:34.748064 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-2ee9774d-39d7-4715-9e70-7c9385146c36 req-5bfda7e9-8b02-4cb1-80cb-7ad62bbc3a4c service nova] Creating event network-vif-plugged:b4084b0c-b4e3-4380-b521-ec05e08e1f79 for instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf on hv-cinder-85426 Aug 30 04:34:34.754112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-2ee9774d-39d7-4715-9e70-7c9385146c36 req-5bfda7e9-8b02-4cb1-80cb-7ad62bbc3a4c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047653 Aug 30 04:34:34.755695 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 334/693] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:35.217617 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:35.218328 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:35.226807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.227395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.228019 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.228736 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.229291 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.229826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.338266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:35.339213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:35.340087 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:35.340819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:35.341572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:35.357230 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.358264 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.359278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.362479 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.364125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.365592 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.400256 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for project cf24ec2c8bd74974932690a583961691. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:35.408472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Getting quotas for user 91067603d9c549278cdc2d97b54cca88 and project cf24ec2c8bd74974932690a583961691. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:35.434346 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:35.437640 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:35.461987 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.473150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5f728aec-ac75-4ec1-8cbb-c66155db73f6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1682 microversion: 2.1 time: 0.259845 Aug 30 04:34:35.473796 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 335/694] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:35 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:35.500423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-47d6b999-d7a8-4408-9e39-f8da7ed693cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.925184 Aug 30 04:34:35.501185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 360/695] 10.222.0.91 () {62 vars in 1188 bytes} [Tue Aug 30 04:34:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 04:34:35.517879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a94fdc37-e6de-4280-a7a1-4e6a963c1277 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:35.519134 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a94fdc37-e6de-4280-a7a1-4e6a963c1277 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:35.522967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:35.614753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a94fdc37-e6de-4280-a7a1-4e6a963c1277 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.630364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a94fdc37-e6de-4280-a7a1-4e6a963c1277 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.633999 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a94fdc37-e6de-4280-a7a1-4e6a963c1277 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.636459 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a94fdc37-e6de-4280-a7a1-4e6a963c1277 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1281 microversion: 2.20 time: 0.126304 Aug 30 04:34:35.637493 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 336/696] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:35 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:35.723463 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:35.724527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:35.732651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.733271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.733765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.734664 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.735422 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.736188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.752715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:35.913943 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.922560 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0c233191-5ad7-4834-b404-72c92f2adc15 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1361 microversion: 2.1 time: 0.204519 Aug 30 04:34:35.923174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 361/697] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:35 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:36.495708 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.496299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.504909 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.505693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.506903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.507671 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.508150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.508591 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.664066 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.664825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.676589 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.677971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.678683 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.679716 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.680335 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.680877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.774274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:36.790735 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:36.795055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:36.798361 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:36.800599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-83bbb4f6-5ee8-44b0-887c-15fb47c5efb0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1277 microversion: 2.20 time: 0.143095 Aug 30 04:34:36.802566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 362/698] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:36.808825 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-290806b1-b2d5-43a2-b291-a0866a23a7a2 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1682 microversion: 2.1 time: 0.315389 Aug 30 04:34:36.811090 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 337/699] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1682 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:36.954374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.956561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.969423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.970718 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.971504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.974194 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.975112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.976115 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.211671 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:37.223935 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e9d9295d-f3fd-4fd0-80b7-2cc9d1a816c5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1361 microversion: 2.1 time: 0.277107 Aug 30 04:34:37.225109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 363/700] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:37.373968 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-a5030c6b-8491-434f-b085-e87d6631605c req-5f0029ec-90d7-452e-b468-70218df62205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe95c6ff-83ad-4fcd-9d95-59695f830f10", "name": "network-vif-deleted", "tag": "a9781c66-5eab-4e93-b9ce-28d28cc15f3c"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:37.407444 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-a5030c6b-8491-434f-b085-e87d6631605c req-5f0029ec-90d7-452e-b468-70218df62205 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.408379 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-a5030c6b-8491-434f-b085-e87d6631605c req-5f0029ec-90d7-452e-b468-70218df62205 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.409150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-a5030c6b-8491-434f-b085-e87d6631605c req-5f0029ec-90d7-452e-b468-70218df62205 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.436582 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-a5030c6b-8491-434f-b085-e87d6631605c req-5f0029ec-90d7-452e-b468-70218df62205 service nova] Creating event network-vif-deleted:a9781c66-5eab-4e93-b9ce-28d28cc15f3c for instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 on hv-cinder-85426 Aug 30 04:34:37.445211 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-a5030c6b-8491-434f-b085-e87d6631605c req-5f0029ec-90d7-452e-b468-70218df62205 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076685 Aug 30 04:34:37.446814 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 338/701] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:37.827390 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:37.828638 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:37.841549 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.842633 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.843353 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.844590 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.845316 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.846010 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.846777 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:37.847899 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:37.860141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.861413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.862084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.863508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.864540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.865212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.983350 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.006060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.010106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.013856 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3c5b22c2-42a0-45b1-b4a2-6d858965882e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1333 microversion: 2.20 time: 0.191085 Aug 30 04:34:38.015843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 364/702] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:37 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1333 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:38.029558 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.049941 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6e2b0273-7fb0-4844-82a2-f23bff091539 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1615 microversion: 2.1 time: 0.215338 Aug 30 04:34:38.050910 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 339/703] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:37 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1615 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:38.249014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:38.249904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:38.258686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.259703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.261755 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.263019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.263776 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.264435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.451526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.465572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-388cf029-a750-4a97-a865-c595c891e41c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1547 microversion: 2.1 time: 0.221800 Aug 30 04:34:38.467051 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 365/704] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:38 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1547 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:38.498072 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:38.498653 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:38.507007 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.507822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.508299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.509127 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.509743 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.510178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.614313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8f2ced54-6acb-44c8-a9ac-2c78fe6e9f0e tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120307 Aug 30 04:34:38.615352 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 340/705] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:34:38 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:39.042726 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:39.047232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:39.059334 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.060613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.061625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.063431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.064534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.065580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.090086 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:39.090086 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:39.100938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.101436 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.103297 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.104558 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.105802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.106788 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.173515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.174034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.174478 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.174942 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lazy-loading 'fault' on Instance uuid fe95c6ff-83ad-4fcd-9d95-59695f830f10 {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:39.194996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.204504 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.206050 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.207299 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d634c0a3-ee68-4ee5-b021-ff9e43d33ebc tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1351 microversion: 2.20 time: 0.173099 Aug 30 04:34:39.207880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 366/706] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:39.368946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.378146 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-628e3f6c-66ee-43a2-913e-b49570a145ee tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 200 len: 1332 microversion: 2.1 time: 0.295792 Aug 30 04:34:39.378781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 341/707] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:40.233125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.234229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.244451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.245266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.245918 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.246960 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.247539 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.248131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.339898 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.351459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.353279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.355284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4a66086d-8b6b-410e-9d26-0fff19421934 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1339 microversion: 2.20 time: 0.127322 Aug 30 04:34:40.365632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 367/708] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:40 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:40.416864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.418226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.428175 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.429225 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.429685 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.430437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.430882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.431311 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.449085 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 HTTP/1.1 Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:34:40.450789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:34:40.459449 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'fe95c6ff-83ad-4fcd-9d95-59695f830f10'} Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:40.460881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:34:40.464111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:40.469147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:40.469147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-16ddd527-4088-42de-9530-805ee853f129 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 404 len: 111 microversion: 2.1 time: 0.043325 Aug 30 04:34:40.469147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 342/709] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:40 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:40.469892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b5b5da6e-d12f-4371-acae-773d26eb697a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '.version_select at 0x7f24ec4f0d30>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.489592 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b5b5da6e-d12f-4371-acae-773d26eb697a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129582369" status: 202 len: 0 microversion: 2.1 time: 0.029124 Aug 30 04:34:40.490485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 368/710] 10.222.0.91 () {58 vars in 1221 bytes} [Tue Aug 30 04:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129582369 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:41.058825 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-d6c65e45-61c9-4710-b3f9-1f71832a801d req-e18ffae0-2456-44e8-bd75-73ca2bbe890d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999dbbf6-840d-4eb7-ab9e-291b3de143cf", "tag": "b4084b0c-b4e3-4380-b521-ec05e08e1f79"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:41.080230 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d6c65e45-61c9-4710-b3f9-1f71832a801d req-e18ffae0-2456-44e8-bd75-73ca2bbe890d service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.081711 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d6c65e45-61c9-4710-b3f9-1f71832a801d req-e18ffae0-2456-44e8-bd75-73ca2bbe890d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.082843 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-d6c65e45-61c9-4710-b3f9-1f71832a801d req-e18ffae0-2456-44e8-bd75-73ca2bbe890d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.125303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-d6c65e45-61c9-4710-b3f9-1f71832a801d req-e18ffae0-2456-44e8-bd75-73ca2bbe890d service nova] Creating event network-changed:b4084b0c-b4e3-4380-b521-ec05e08e1f79 for instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf on hv-cinder-85426 Aug 30 04:34:41.138250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-d6c65e45-61c9-4710-b3f9-1f71832a801d req-e18ffae0-2456-44e8-bd75-73ca2bbe890d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086754 Aug 30 04:34:41.144698 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 343/711] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:41.626098 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.627713 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.649404 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.650013 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.650532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.651391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.652162 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.653581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.923435 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-55ec544d-87d6-48d0-bc6c-a87820cd28d7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: .version_select at 0x7f24ec51d160>, body: {"keypair": {"name": "tempest-keypair-830910128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVTOy1LTdlL1Rfc92gPJjoTGrEkYqvFa7Fz9AllG6J3DzQ2tq0Y2oitsqVTuu/NG73yeK4FQ3iDb+NvxSQoGKJuNY6j4Nl8Gv+mvo75SQp5UHwtx9tWbxJukQ/rMwx0+g=="}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:41.966481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-55ec544d-87d6-48d0-bc6c-a87820cd28d7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:41.975318 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-55ec544d-87d6-48d0-bc6c-a87820cd28d7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:42.026991 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-55ec544d-87d6-48d0-bc6c-a87820cd28d7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111290 Aug 30 04:34:42.038647 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:42.039702 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 344/712] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:34:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:42.050118 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:42.051316 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:42.053722 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:42.055508 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:42.059027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a3cc6fa2-46e6-4f6b-8c6e-e19a32cccc9b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1406 microversion: 2.20 time: 0.677944 Aug 30 04:34:42.059643 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 369/713] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1406 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:42.063084 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:42.063962 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:42.064751 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:42.066251 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:42.066994 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:42.067766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:42.201398 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'services' on Instance uuid a6eea27d-ad1c-4c9e-9da5-a95042f47304 {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:42.309012 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1d326c9f-36c9-4db2-bcd2-8ce6b2906eb8 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments/0c93eb6b-cfe5-42e8-85fa-822cf2dba852" status: 202 len: 0 microversion: 2.1 time: 0.266916 Aug 30 04:34:42.310640 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 345/714] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:34:42 2022] DELETE /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments/0c93eb6b-cfe5-42e8-85fa-822cf2dba852 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:42.327071 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:42.341868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:42.373741 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:42.374610 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:42.375729 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:42.377144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:42.377974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:42.379064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:42.454118 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0d8411f6-6952-45b7-b05c-1b053eaeab5a tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135570 Aug 30 04:34:42.455142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 370/715] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:42 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:43.089372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:43.090602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:43.107734 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.109961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.110849 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.112556 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.113585 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.114626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.172320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-96293a1e-f559-4ec0-8ced-053b70b40bbd req-58b8bf62-9f84-452f-8a0a-a6a815a950cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ff6f54-9208-47dc-a7d6-8bbd2f361078", "tag": "8f9dcf42-2c92-4dfb-86be-a86c9029c626"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:43.191057 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:43.196258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-96293a1e-f559-4ec0-8ced-053b70b40bbd req-58b8bf62-9f84-452f-8a0a-a6a815a950cc service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.196747 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-96293a1e-f559-4ec0-8ced-053b70b40bbd req-58b8bf62-9f84-452f-8a0a-a6a815a950cc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.197182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-96293a1e-f559-4ec0-8ced-053b70b40bbd req-58b8bf62-9f84-452f-8a0a-a6a815a950cc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.210933 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-96293a1e-f559-4ec0-8ced-053b70b40bbd req-58b8bf62-9f84-452f-8a0a-a6a815a950cc service nova] Creating event network-changed:8f9dcf42-2c92-4dfb-86be-a86c9029c626 for instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 on hv-cinder-85426 Aug 30 04:34:43.216308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-96293a1e-f559-4ec0-8ced-053b70b40bbd req-58b8bf62-9f84-452f-8a0a-a6a815a950cc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052592 Aug 30 04:34:43.217100 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 371/716] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:43.475424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:43.477883 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:43.494347 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.494857 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.495374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.496258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.497033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.499625 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.503409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:43.534557 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:43.536229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:43.537591 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2679fed2-a7f9-4ce6-b023-9be4f2c247a7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1406 microversion: 2.20 time: 0.457699 Aug 30 04:34:43.538607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 346/717] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:43 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:43.547723 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0bb03550-d0a9-4b60-b270-329018d7e2ea tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081273 Aug 30 04:34:43.548360 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 372/718] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:43 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:34:43.685551 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:43.686543 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:43.700666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.703162 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.706396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.706396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.706846 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.707662 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.755319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:43.880427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ae6e486b-0cc1-405a-96c4-1e1c5f6f3e7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 204 len: 0 microversion: 2.1 time: 0.203316 Aug 30 04:34:43.886208 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 347/719] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:43 2022] DELETE /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:43.892229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:43.892953 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:43.908662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.909235 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.909947 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.910895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.911515 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.912300 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.132552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.142482 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4450fba9-6aa1-450f-a25c-c58e7a378a13 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1688 microversion: 2.1 time: 0.254707 Aug 30 04:34:44.143318 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 373/720] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:43 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1688 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:44.544490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-840684364", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0fa4781-7b10-40fd-9cd8-6b3044f7ba50"}], "security_groups": [{"name": "tempest-securitygroup--2103007490"}], "key_name": "tempest-keypair-830910128", "user_data": "}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:44.585850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:44.586942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:44.596872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.597400 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.598300 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.598898 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.599853 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.600108 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.690144 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] validate_networks() for [('a0fa4781-7b10-40fd-9cd8-6b3044f7ba50', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:34:44.917887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.933240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.935145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.936598 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-384aacc1-04e9-4b85-9bdc-0a4deb780752 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1406 microversion: 2.20 time: 0.359108 Aug 30 04:34:44.937343 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 374/721] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:44 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:45.134894 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:45.135309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:45.135796 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:45.136271 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:45.136676 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:45.147691 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.148283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.148755 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.149528 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.150161 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.150897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.168237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:45.169051 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:45.176350 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:45.177337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.178103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.178701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.179962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.180606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.181174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.182909 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:45.201092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:45.203893 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:45.272987 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-397da1bf-77c5-441e-b501-c742b9613db5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.733360 Aug 30 04:34:45.275722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 348/722] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:34:45.288963 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-40978edf-da91-495e-9aaf-d82dfadf4548 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:45.290437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-40978edf-da91-495e-9aaf-d82dfadf4548 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:45.377713 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-40978edf-da91-495e-9aaf-d82dfadf4548 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:45.380942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:45.411643 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-40978edf-da91-495e-9aaf-d82dfadf4548 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1240 microversion: 2.1 time: 0.127683 Aug 30 04:34:45.413515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 349/723] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:45 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:45.415220 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:45.426239 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=10 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:45.431262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6bb75680-8177-4315-b219-6fd65043956b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1688 microversion: 2.1 time: 0.267416 Aug 30 04:34:45.432233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 375/724] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:45 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1688 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:45.963174 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:45.964050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:45.973470 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.974649 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.975213 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.976411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.977087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.977745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.187013 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.202653 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.205679 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.207681 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-84f03fe7-46e9-44f1-bb23-5f32c85e961a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1406 microversion: 2.20 time: 0.248654 Aug 30 04:34:46.209315 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 350/725] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:45 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:46.435561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:46.436507 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:46.444993 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.445492 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.445931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.446659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.447119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.447555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.549750 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.559460 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cd9ec97b-3567-4348-b5e8-458e404eddcc tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1244 microversion: 2.1 time: 0.127986 Aug 30 04:34:46.560106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 376/726] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:46 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1244 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:46.673356 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:46.674481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:46.683262 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.684195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.684792 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.686005 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.686595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.687123 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.858395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.867466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-95041ef4-97ec-46b7-999a-4ed82dc69491 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1688 microversion: 2.1 time: 0.411394 Aug 30 04:34:46.868136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 351/727] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:46 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1688 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:47.248246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.248966 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.257932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.258507 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.259017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.259894 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.260574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.261078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.585270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.586271 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.596614 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.597250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.598285 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.599091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.599677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.600305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.680535 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.689442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d691337b-c617-4a0a-8c94-d19cef9f3ef5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1244 microversion: 2.1 time: 0.111889 Aug 30 04:34:47.690330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 352/728] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:47 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1244 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:47.729457 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.738741 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.742580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.743364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9d9711f3-53f5-4fe6-91b5-36972d1e4e7d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1406 microversion: 2.20 time: 0.499960 Aug 30 04:34:47.744122 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 377/729] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:47 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:47.890560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.891239 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.899041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.899594 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.900124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.901334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.901834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.902293 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.060576 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:48.069905 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-62928ef5-0ab5-40cb-8223-98fb6da2511d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1688 microversion: 2.1 time: 0.184208 Aug 30 04:34:48.070560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 353/730] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:47 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:48.737041 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.738117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.753049 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-8d5fd72e-e2f6-4c4b-b814-1c8ad7f2cd82 req-591011cd-a837-4f67-9fba-aba545afbec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ff6f54-9208-47dc-a7d6-8bbd2f361078", "name": "network-vif-plugged", "status": "completed", "tag": "8f9dcf42-2c92-4dfb-86be-a86c9029c626"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:48.753676 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.753881 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.754632 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.761020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.764652 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.767285 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.776659 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8d5fd72e-e2f6-4c4b-b814-1c8ad7f2cd82 req-591011cd-a837-4f67-9fba-aba545afbec2 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.777799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8d5fd72e-e2f6-4c4b-b814-1c8ad7f2cd82 req-591011cd-a837-4f67-9fba-aba545afbec2 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.778393 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8d5fd72e-e2f6-4c4b-b814-1c8ad7f2cd82 req-591011cd-a837-4f67-9fba-aba545afbec2 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.807610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-8d5fd72e-e2f6-4c4b-b814-1c8ad7f2cd82 req-591011cd-a837-4f67-9fba-aba545afbec2 service nova] Creating event network-vif-plugged:8f9dcf42-2c92-4dfb-86be-a86c9029c626 for instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 on hv-cinder-85426 Aug 30 04:34:48.819956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-8d5fd72e-e2f6-4c4b-b814-1c8ad7f2cd82 req-591011cd-a837-4f67-9fba-aba545afbec2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071155 Aug 30 04:34:48.821752 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 354/731] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:48.835591 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.836395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.850314 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.851016 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.851631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.852578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.853185 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.853979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.997246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.024217 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ea61614b-e95e-488a-908f-ed15ba7007ed tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1292 microversion: 2.1 time: 0.303139 Aug 30 04:34:49.039947 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 378/732] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1292 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:49.097168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:49.099235 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:49.109211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:49.110023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:49.110705 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:49.111784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:49.112876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:49.113478 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:49.442782 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.446717 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=100 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:49.464790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fb832e8d-0600-4136-b043-be3b8b8ba6d1 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1688 microversion: 2.1 time: 0.374966 Aug 30 04:34:49.474524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 379/733] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:49 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1688 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:49.586788 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.602124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.605377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.607520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-45ca8f8d-7106-4bf9-a565-7ffa760cbcf6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1406 microversion: 2.20 time: 0.784311 Aug 30 04:34:49.609009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 355/734] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1406 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:50.070708 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:50.076854 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:50.095673 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.106954 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.107794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.109197 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.110036 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.110792 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.263745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.279136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f6066e1d-6354-495f-8024-8008ba54b892 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1310 microversion: 2.1 time: 0.215407 Aug 30 04:34:50.280440 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 380/735] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:50 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1310 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:50.495543 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-15e3314e-8423-4937-ba28-19fcf60431cb req-7cb0c973-edee-485e-aea0-a17e23c09ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6eea27d-ad1c-4c9e-9da5-a95042f47304", "name": "network-vif-deleted", "tag": "8cae059a-7b2c-4abb-9d46-5df4d36ea2ef"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:50.499563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:50.501340 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:50.513532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.513883 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-15e3314e-8423-4937-ba28-19fcf60431cb req-7cb0c973-edee-485e-aea0-a17e23c09ebc service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.514348 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.514560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-15e3314e-8423-4937-ba28-19fcf60431cb req-7cb0c973-edee-485e-aea0-a17e23c09ebc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.515462 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-15e3314e-8423-4937-ba28-19fcf60431cb req-7cb0c973-edee-485e-aea0-a17e23c09ebc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.515794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.517554 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.518656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.519740 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.542560 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-15e3314e-8423-4937-ba28-19fcf60431cb req-7cb0c973-edee-485e-aea0-a17e23c09ebc service nova] Creating event network-vif-deleted:8cae059a-7b2c-4abb-9d46-5df4d36ea2ef for instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 on hv-cinder-85426 Aug 30 04:34:50.555824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-15e3314e-8423-4937-ba28-19fcf60431cb req-7cb0c973-edee-485e-aea0-a17e23c09ebc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065704 Aug 30 04:34:50.558228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 356/736] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:50.642076 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:50.661565 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:50.673376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.674649 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.675893 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.677819 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.678944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.680362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.732080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.755714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-925697c5-3d29-44e1-a9c2-f9f3a73955d5 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1621 microversion: 2.1 time: 0.262891 Aug 30 04:34:50.757145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 381/737] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:50 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1621 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:50.964668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.984936 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.986645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.987842 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c717b412-13a8-4e4a-9405-e1778e5263b6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1406 microversion: 2.20 time: 0.356014 Aug 30 04:34:51.011124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 357/738] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:50 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:51.308603 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.310654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.323269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.324560 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.325279 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.326804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.327887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.328512 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.734444 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:51.755129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d09956f5-1dfd-4e51-bd01-1cfc24081b5e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.454796 Aug 30 04:34:51.756730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 382/739] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:51.783137 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.785250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.797777 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.799265 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.799811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.800972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.801775 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.802615 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.904629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.905457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.906246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.906998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'fault' on Instance uuid a6eea27d-ad1c-4c9e-9da5-a95042f47304 {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:52.024779 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:52.036847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:52.037793 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:52.061833 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.062181 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5bacc173-de0b-4f3c-bf55-0750529a633f tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 200 len: 1335 microversion: 2.1 time: 0.286466 Aug 30 04:34:52.067293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.068206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.069395 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.070037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.070617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.102623 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 358/740] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 1335 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:52.486215 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:52.498000 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:52.499626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:52.501326 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-772814ef-f24d-4700-aa3c-3a3d19a0745a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1598 microversion: 2.20 time: 0.485108 Aug 30 04:34:52.502804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 383/741] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:52 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1598 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:52.540542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:52.540989 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:52.547740 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.548342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.548894 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.549744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.550262 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.550779 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.660828 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fa10790e-9365-4e8f-a491-aaff1fb8a816 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126299 Aug 30 04:34:52.661828 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 359/742] 10.222.0.91 () {60 vars in 1316 bytes} [Tue Aug 30 04:34:52 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:34:52.790800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:52.791762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:52.801233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.801979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.802525 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.805061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.805747 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.806303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.022290 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-b80972b7-1fc6-437a-90eb-560a6002bb63 req-cb082ff9-4b7e-4061-a72f-69d3d1f9be48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae46ccaf-4960-42d3-b45a-77d43f25430c", "tag": "59e04df4-f99f-4ee9-9e65-958642187f1c"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:53.060704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b80972b7-1fc6-437a-90eb-560a6002bb63 req-cb082ff9-4b7e-4061-a72f-69d3d1f9be48 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:53.061596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b80972b7-1fc6-437a-90eb-560a6002bb63 req-cb082ff9-4b7e-4061-a72f-69d3d1f9be48 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:53.062378 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-b80972b7-1fc6-437a-90eb-560a6002bb63 req-cb082ff9-4b7e-4061-a72f-69d3d1f9be48 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.094233 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-b80972b7-1fc6-437a-90eb-560a6002bb63 req-cb082ff9-4b7e-4061-a72f-69d3d1f9be48 service nova] Creating event network-changed:59e04df4-f99f-4ee9-9e65-958642187f1c for instance ae46ccaf-4960-42d3-b45a-77d43f25430c on hv-cinder-85426 Aug 30 04:34:53.104220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-b80972b7-1fc6-437a-90eb-560a6002bb63 req-cb082ff9-4b7e-4061-a72f-69d3d1f9be48 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090822 Aug 30 04:34:53.105334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 360/743] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:53.114976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:53.116250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: a6eea27d-ad1c-4c9e-9da5-a95042f47304] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:53.129661 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:53.130754 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:53.131382 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.132807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:53.133632 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:53.135060 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.169471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] HTTP exception thrown: Instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 could not be found. Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Request method failure captured: Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 HTTP/1.1 Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI5wHVu63y0quaUniqRTR3Rdq3_hKasNXmOKcEjaFEPRz2Q6YV9t3NY4sLsy63qIsgRroIX5HqT2kuff3-AzB400MVTV919FNDOQso0tdigaOajD1MR1Coxjek0embcSMpp6HC91cX_nnjwfXU1h8FkL2oaltPTQuUPtBh1n9Su2tc Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:34:53.171928 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 589bd91dbf434099b15ed7a8680f93bb Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 could not be found. Aug 30 04:34:53.174904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'a6eea27d-ad1c-4c9e-9da5-a95042f47304'} Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 could not be found. Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:53.178113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 could not be found. Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 could not be found. Aug 30 04:34:53.180952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:34:53.183364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Returning 404 to user: Instance a6eea27d-ad1c-4c9e-9da5-a95042f47304 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:53.183364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-84d593e4-548f-4e88-8905-51ed5b8aaffa tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304" status: 404 len: 111 microversion: 2.1 time: 0.067381 Aug 30 04:34:53.183364 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 361/744] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:53 2022] GET /compute/v2.1/servers/a6eea27d-ad1c-4c9e-9da5-a95042f47304 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:53.190982 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-47ed10b7-de13-4be8-84d1-411dc36154b7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '.version_select at 0x7f24ec582f70>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:53.236879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-47ed10b7-de13-4be8-84d1-411dc36154b7 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851863934" status: 202 len: 0 microversion: 2.1 time: 0.053188 Aug 30 04:34:53.239726 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 362/745] 10.222.0.91 () {58 vars in 1218 bytes} [Tue Aug 30 04:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851863934 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:53.262359 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:53.282188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-df2f3521-c44d-453b-9b81-6434e8918704 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.496880 Aug 30 04:34:53.284207 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 384/746] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:52 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:54.320420 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:54.321468 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:54.335307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.336274 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.336995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.338233 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.339024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.339751 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.691322 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-bfa5dbdb-5e97-49e3-8121-8a361b43ddc4 req-b2324444-d855-4f03-97e8-e8aa0dab29ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ff6f54-9208-47dc-a7d6-8bbd2f361078", "tag": "8f9dcf42-2c92-4dfb-86be-a86c9029c626"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:54.720357 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-bfa5dbdb-5e97-49e3-8121-8a361b43ddc4 req-b2324444-d855-4f03-97e8-e8aa0dab29ab service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.721688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-bfa5dbdb-5e97-49e3-8121-8a361b43ddc4 req-b2324444-d855-4f03-97e8-e8aa0dab29ab service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.723077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-bfa5dbdb-5e97-49e3-8121-8a361b43ddc4 req-b2324444-d855-4f03-97e8-e8aa0dab29ab service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.744748 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:54.761263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-bfa5dbdb-5e97-49e3-8121-8a361b43ddc4 req-b2324444-d855-4f03-97e8-e8aa0dab29ab service nova] Creating event network-changed:8f9dcf42-2c92-4dfb-86be-a86c9029c626 for instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 on hv-cinder-85426 Aug 30 04:34:54.764093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-99564ee3-3a00-4c67-99cc-a2e0355239dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.451018 Aug 30 04:34:54.765789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 363/747] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:54 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:54.783260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-bfa5dbdb-5e97-49e3-8121-8a361b43ddc4 req-b2324444-d855-4f03-97e8-e8aa0dab29ab service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209783 Aug 30 04:34:54.785055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 385/748] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:55.811716 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:55.812860 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:55.816259 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:55.819595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=14 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:55.829550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.830382 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.831110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.832387 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.833785 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.834582 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:56.036147 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:56.050626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c4e272d8-0ff7-4e08-a7f6-7419372c5b4e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.251097 Aug 30 04:34:56.051753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 364/749] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:55 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:57.085356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.086121 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.093606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.094110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.094547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.095282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.095735 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.096201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.291484 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:57.303757 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e611221c-2e6c-4b4d-a0d1-d0efe3f03396 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.224355 Aug 30 04:34:57.305097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 386/750] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:57 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:57.330593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.331537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.336092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:57.343858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.344543 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.345070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.345983 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.346536 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.347056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.386164 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:57.427761 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:57.487403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8cf2004b-6feb-4bad-a8ed-3fbcf7b64e59 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "DELETE /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 204 len: 0 microversion: 2.1 time: 0.161529 Aug 30 04:34:57.488369 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 365/751] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:57 2022] DELETE /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:34:57.499743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.500505 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.508311 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.508937 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.509469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.510302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.510848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.511373 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.671628 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:57.681274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ee11069a-2d24-4995-9671-54ed234b7fa3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1506 microversion: 2.1 time: 0.186157 Aug 30 04:34:57.681880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 387/752] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:57 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:58.333508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:58.334888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:58.342580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.343107 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.343544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.344321 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.344757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.345183 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.512173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:58.527721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-50c4aae4-1aaf-4ad9-b39d-4c22318016cf tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.198381 Aug 30 04:34:58.528847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 366/753] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:58 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:58.682332 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-d16f6731-9893-48c7-a4f2-039b87b03ce5 req-ad583f94-f787-4c61-be49-e241a57f1c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae46ccaf-4960-42d3-b45a-77d43f25430c", "name": "network-vif-plugged", "status": "completed", "tag": "59e04df4-f99f-4ee9-9e65-958642187f1c"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.696028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d16f6731-9893-48c7-a4f2-039b87b03ce5 req-ad583f94-f787-4c61-be49-e241a57f1c15 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.696828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d16f6731-9893-48c7-a4f2-039b87b03ce5 req-ad583f94-f787-4c61-be49-e241a57f1c15 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.698104 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d16f6731-9893-48c7-a4f2-039b87b03ce5 req-ad583f94-f787-4c61-be49-e241a57f1c15 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.709680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:58.712005 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:58.716293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-d16f6731-9893-48c7-a4f2-039b87b03ce5 req-ad583f94-f787-4c61-be49-e241a57f1c15 service nova] Creating event network-vif-plugged:59e04df4-f99f-4ee9-9e65-958642187f1c for instance ae46ccaf-4960-42d3-b45a-77d43f25430c on hv-cinder-85426 Aug 30 04:34:58.723280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-d16f6731-9893-48c7-a4f2-039b87b03ce5 req-ad583f94-f787-4c61-be49-e241a57f1c15 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045499 Aug 30 04:34:58.724077 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.724654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 388/754] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:58.725516 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.726242 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.727688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.728729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.729459 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.919701 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:58.930858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7a744171-d3f4-4766-8348-457358d578e3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1506 microversion: 2.1 time: 0.229568 Aug 30 04:34:58.931468 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 367/755] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:58 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:59.552100 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:59.553163 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:59.560352 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.560838 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.561285 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:59.561998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.562449 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.562872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:59.738760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:59.748430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c10e2c97-5887-4ddb-86c6-51808443aac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.201000 Aug 30 04:34:59.749037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 389/756] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:59 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:59.964823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:59.965525 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:59.972541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.973030 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.973464 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:59.974871 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.975374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.975806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.144390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:00.154229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3191c1f2-fcc1-4787-a33d-0c4b9274eb6b tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1506 microversion: 2.1 time: 0.193215 Aug 30 04:35:00.154984 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 368/757] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:59 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:00.782925 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:00.783733 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:00.792644 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.793213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.793707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.794925 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.795669 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.796439 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.021310 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:01.031539 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-62c184f2-ed69-4e95-a5c0-c2eddbfa6816 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.252954 Aug 30 04:35:01.032352 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 390/758] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:00 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:01.176597 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:01.177756 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:01.184834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:01.185316 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:01.185748 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.186453 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:01.186890 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:01.187302 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.569951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:01.581115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-1aac60fb-e764-431f-bcff-22ec06168b43 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1506 microversion: 2.1 time: 0.409406 Aug 30 04:35:01.581718 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 369/759] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:01 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:01.659328 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-5e93b6fe-0b0a-431f-a110-aca8fae59815 req-ba91ffa1-ce74-4e2e-9953-d17b72668d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beaafec3-5f47-4d5f-bc1c-76a9d298c6f0", "name": "network-vif-deleted", "tag": "6ba6f446-03eb-4bc2-b1f9-d5d271187715"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:01.681271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-5e93b6fe-0b0a-431f-a110-aca8fae59815 req-ba91ffa1-ce74-4e2e-9953-d17b72668d54 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:01.681766 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-5e93b6fe-0b0a-431f-a110-aca8fae59815 req-ba91ffa1-ce74-4e2e-9953-d17b72668d54 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:01.682360 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-5e93b6fe-0b0a-431f-a110-aca8fae59815 req-ba91ffa1-ce74-4e2e-9953-d17b72668d54 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.704081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-5e93b6fe-0b0a-431f-a110-aca8fae59815 req-ba91ffa1-ce74-4e2e-9953-d17b72668d54 service nova] Creating event network-vif-deleted:6ba6f446-03eb-4bc2-b1f9-d5d271187715 for instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 on hv-cinder-85426 Aug 30 04:35:01.711821 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-5e93b6fe-0b0a-431f-a110-aca8fae59815 req-ba91ffa1-ce74-4e2e-9953-d17b72668d54 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056841 Aug 30 04:35:01.712886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 391/760] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:02.055349 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:02.056069 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:02.063331 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.063982 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.064431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.065166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.065618 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.066037 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.249847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:02.259414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-dacab837-6e51-47c5-9e79-1c8a5d24e183 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1366 microversion: 2.1 time: 0.208102 Aug 30 04:35:02.260016 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 370/761] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:02 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:02.615660 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:02.616513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:02.619758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:02.627491 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.628148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.628584 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.629464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.629869 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.630333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.671631 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.672291 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.673097 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.673772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'fault' on Instance uuid beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:02.727216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:02.742510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ecb0d910-0349-403e-b488-ec3d0d49a691 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 200 len: 1311 microversion: 2.1 time: 0.132084 Aug 30 04:35:02.743571 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 392/762] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:02 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:03.282907 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:03.283754 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:03.293093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.293622 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.294045 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.294764 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.295234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.295657 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.481111 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:03.507342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f1759469-8666-4c89-a5c9-ef33360741a6 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1557 microversion: 2.1 time: 0.228638 Aug 30 04:35:03.507988 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 371/763] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:03 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:03.529277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:03.529938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:03.539546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.540197 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.540736 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.541472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.541927 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.542353 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.638161 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f5afea95-9663-4a0e-8e6e-92f01729aa5a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112593 Aug 30 04:35:03.639172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 393/764] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:35:03 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:03.777681 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:03.778204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: beaafec3-5f47-4d5f-bc1c-76a9d298c6f0] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:03.784640 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.785139 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.785596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.786492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.787396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.787396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.803457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] HTTP exception thrown: Instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 could not be found. Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Request method failure captured: Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 HTTP/1.1 Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI5wHVu63y0quaUniqRTR3Rdq3_hKasNXmOKcEjaFEPRz2Q6YV9t3NY4sLsy63qIsgRroIX5HqT2kuff3-AzB400MVTV919FNDOQso0tdigaOajD1MR1Coxjek0embcSMpp6HC91cX_nnjwfXU1h8FkL2oaltPTQuUPtBh1n9Su2tc Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:35:03.805155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 589bd91dbf434099b15ed7a8680f93bb Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 could not be found. Aug 30 04:35:03.807722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'beaafec3-5f47-4d5f-bc1c-76a9d298c6f0'} Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 could not be found. Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:03.809246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 could not be found. Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 could not be found. Aug 30 04:35:03.812307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:03.814642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Returning 404 to user: Instance beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:03.814642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-596b0e10-db6b-4e36-afaa-94159ef31498 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0" status: 404 len: 111 microversion: 2.1 time: 0.033068 Aug 30 04:35:03.814642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 372/765] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:03 2022] GET /compute/v2.1/servers/beaafec3-5f47-4d5f-bc1c-76a9d298c6f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:03.822532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:03.823237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:03.831542 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.832139 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.832758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.834322 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.834815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.835253 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.867534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:03.994690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-afcebc05-a019-4445-9963-5c90624852a0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 204 len: 0 microversion: 2.1 time: 0.177221 Aug 30 04:35:03.996251 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 394/766] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:03 2022] DELETE /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:04.006732 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:04.007571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:04.016039 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.016791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.017344 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.018570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.019333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.020056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.337607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:04.352634 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c9cace6c-b159-4b99-b340-476604e1317c tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.350442 Aug 30 04:35:04.353646 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 373/767] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:04 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:05.028601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-ec79715f-430e-45fd-a07a-526db300dc46 req-a2dbed3c-91c7-4a43-bb78-662f7c2ea79e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae46ccaf-4960-42d3-b45a-77d43f25430c", "tag": "59e04df4-f99f-4ee9-9e65-958642187f1c"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:05.048341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-ec79715f-430e-45fd-a07a-526db300dc46 req-a2dbed3c-91c7-4a43-bb78-662f7c2ea79e service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.049157 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-ec79715f-430e-45fd-a07a-526db300dc46 req-a2dbed3c-91c7-4a43-bb78-662f7c2ea79e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.049896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-ec79715f-430e-45fd-a07a-526db300dc46 req-a2dbed3c-91c7-4a43-bb78-662f7c2ea79e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.066812 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-ec79715f-430e-45fd-a07a-526db300dc46 req-a2dbed3c-91c7-4a43-bb78-662f7c2ea79e service nova] Creating event network-changed:59e04df4-f99f-4ee9-9e65-958642187f1c for instance ae46ccaf-4960-42d3-b45a-77d43f25430c on hv-cinder-85426 Aug 30 04:35:05.075563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-ec79715f-430e-45fd-a07a-526db300dc46 req-a2dbed3c-91c7-4a43-bb78-662f7c2ea79e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051024 Aug 30 04:35:05.076648 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 395/768] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:05.382316 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:05.383267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:05.391112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.391544 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.392289 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.393094 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.393611 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.394058 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.602004 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:05.611718 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-25db8939-038f-4726-8aee-af0da495aa6d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.237845 Aug 30 04:35:05.612579 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 374/769] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:05 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:05.922186 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1872314007"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:05.922874 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:05.932850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.933498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.934033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.935221 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.936057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.936814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.144327 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.network.security_group_api [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Removing security group e6ca7ab1-1f1f-4e8c-9a87-4fdaff65ce83 from port d13cb21f-376e-4f2b-9daf-472725dece64 Aug 30 04:35:06.576701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1189c6b8-4971-4599-a6cd-ea66ae4f8a51 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/action" status: 202 len: 0 microversion: 2.1 time: 0.659698 Aug 30 04:35:06.582425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 396/770] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:35:05 2022] POST /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:06.591284 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-c4368bc3-9307-420d-8ef7-043256597410 req-b9e6ff98-68df-49e3-ab6d-af8ad9c11e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9a6009-b7c3-4bec-9c1f-00487651ecbe", "tag": "d13cb21f-376e-4f2b-9daf-472725dece64"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:06.624507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c4368bc3-9307-420d-8ef7-043256597410 req-b9e6ff98-68df-49e3-ab6d-af8ad9c11e84 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:06.627546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c4368bc3-9307-420d-8ef7-043256597410 req-b9e6ff98-68df-49e3-ab6d-af8ad9c11e84 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:06.628462 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-c4368bc3-9307-420d-8ef7-043256597410 req-b9e6ff98-68df-49e3-ab6d-af8ad9c11e84 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.660024 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-c4368bc3-9307-420d-8ef7-043256597410 req-b9e6ff98-68df-49e3-ab6d-af8ad9c11e84 service nova] Creating event network-changed:d13cb21f-376e-4f2b-9daf-472725dece64 for instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe on hv-cinder-85426 Aug 30 04:35:06.661619 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:06.669190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:06.670296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-c4368bc3-9307-420d-8ef7-043256597410 req-b9e6ff98-68df-49e3-ab6d-af8ad9c11e84 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082966 Aug 30 04:35:06.672149 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 375/771] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:06.683964 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:06.685267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:06.686305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.687653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:06.688742 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:06.690945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.943134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:06.947289 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:06.961142 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4c18945b-1410-4f2d-905b-7823764f99c2 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.314890 Aug 30 04:35:06.963093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 397/772] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:06 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:07.991573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:07.992929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:08.007589 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.008729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.009872 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.011305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.012304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.013830 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.028741 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:08.029707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:08.045593 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.047268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.048305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.049774 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.050528 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.051683 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.172487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lazy-loading 'services' on Instance uuid ec9a6009-b7c3-4bec-9c1f-00487651ecbe {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:08.264122 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0eeea0ba-9cd6-431a-9caf-cf2af3fd1716 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments/3b9258d3-394a-4efb-933d-328757c4d937" status: 202 len: 0 microversion: 2.1 time: 0.247522 Aug 30 04:35:08.264725 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 398/773] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:35:08 2022] DELETE /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments/3b9258d3-394a-4efb-933d-328757c4d937 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:08.270305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-309a0883-baa8-4d7d-816f-53fce6dad92a req-b1ea9d6d-1338-41fb-a909-a7d317b3a943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9a6009-b7c3-4bec-9c1f-00487651ecbe", "tag": "d13cb21f-376e-4f2b-9daf-472725dece64"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:08.280867 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-309a0883-baa8-4d7d-816f-53fce6dad92a req-b1ea9d6d-1338-41fb-a909-a7d317b3a943 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.281400 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-309a0883-baa8-4d7d-816f-53fce6dad92a req-b1ea9d6d-1338-41fb-a909-a7d317b3a943 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.281831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-309a0883-baa8-4d7d-816f-53fce6dad92a req-b1ea9d6d-1338-41fb-a909-a7d317b3a943 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.285212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:08.294774 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-309a0883-baa8-4d7d-816f-53fce6dad92a req-b1ea9d6d-1338-41fb-a909-a7d317b3a943 service nova] Creating event network-changed:d13cb21f-376e-4f2b-9daf-472725dece64 for instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe on hv-cinder-85426 Aug 30 04:35:08.299870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-309a0883-baa8-4d7d-816f-53fce6dad92a req-b1ea9d6d-1338-41fb-a909-a7d317b3a943 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033575 Aug 30 04:35:08.300114 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-19768996-7c02-40ed-b1a7-2a3eb8c0c60e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1521 microversion: 2.1 time: 0.318033 Aug 30 04:35:08.300513 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 399/774] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:08.301483 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 376/775] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:07 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:08.307697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:08.310712 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:08.318071 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.318872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.319517 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.320471 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.321088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.321668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.358011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bb94cb6e-2fa0-433d-9f7e-c85b66e893f4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055908 Aug 30 04:35:08.359213 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 400/776] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:08 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:09.324558 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:09.325959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:09.335740 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.337584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.338857 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.339731 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.340493 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.341187 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.393655 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:09.429485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:09.449996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.450828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.451531 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.452789 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.453554 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.454243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.506743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ad3ba717-0c57-4d5c-83e1-13007590966e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137710 Aug 30 04:35:09.507485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 401/777] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:09 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:35:09.519086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:09.520470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:09.528790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.529292 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.529715 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.530423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.530873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.531403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.635790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] HTTP exception thrown: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe is not attached to volume 3b9258d3-394a-4efb-933d-328757c4d937 Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Request method failure captured: Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments/3b9258d3-394a-4efb-933d-328757c4d937 HTTP/1.1 Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKuO5XPVoYfpjVHL2DhH5R1cqm8cXFIB_-6N4yUkOLklkNcmhgCH1UIygjuMO26_zr6howGAC34HkLNT65agasZCY0HBWebo_yH6OpR0ltarsV7iHUv3SRkb3qi9O_SCGb3AoZjK_OipiIVs9vytpIQRxcDW9KBy-Qqm9lNSAMZdfw Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: da2baee55e704f8cbcf73b9bab63bd9a Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-TestMinimumBasicScenario-689611478 Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:35:09.646371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-TestMinimumBasicScenario-689611478 Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: da2baee55e704f8cbcf73b9bab63bd9a Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-TestMinimumBasicScenario-689611478 Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-TestMinimumBasicScenario-689611478-project Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: ba9817cf82004a5e824a93d1b3ede5cb Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-TestMinimumBasicScenario-689611478-project Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:35:09.647968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe is not attached to volume 3b9258d3-394a-4efb-933d-328757c4d937 Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'server_id': 'ec9a6009-b7c3-4bec-9c1f-00487651ecbe', 'id': '3b9258d3-394a-4efb-933d-328757c4d937'} Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3b9258d3-394a-4efb-933d-328757c4d937. Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:09.651677 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe is not attached to volume 3b9258d3-394a-4efb-933d-328757c4d937 Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe is not attached to volume 3b9258d3-394a-4efb-933d-328757c4d937 Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.653891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Returning 404 to user: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe is not attached to volume 3b9258d3-394a-4efb-933d-328757c4d937 {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:09.656588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-34c58455-8da2-409d-bd23-45917b34c3e1 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments/3b9258d3-394a-4efb-933d-328757c4d937" status: 404 len: 154 microversion: 2.1 time: 0.133526 Aug 30 04:35:09.656588 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 402/778] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:35:09 2022] DELETE /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe/os-volume_attachments/3b9258d3-394a-4efb-933d-328757c4d937 => generated 154 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:09.690067 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:09.700305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-deb02226-6221-473c-9462-6999c1827ba6 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1479 microversion: 2.1 time: 0.380254 Aug 30 04:35:09.701275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 377/779] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:09 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1479 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:10.327302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-a2375be6-0682-44be-a653-2ca26a08cfb4 req-b3dca46a-5cee-47de-862e-cc5d3df6ca68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6cd6eb-b345-40aa-9997-edd0e1d35089", "name": "network-vif-deleted", "tag": "b63e5ca3-4866-40d2-815c-ec29fddad4bf"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:10.342988 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-a2375be6-0682-44be-a653-2ca26a08cfb4 req-b3dca46a-5cee-47de-862e-cc5d3df6ca68 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.343836 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-a2375be6-0682-44be-a653-2ca26a08cfb4 req-b3dca46a-5cee-47de-862e-cc5d3df6ca68 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.344302 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-a2375be6-0682-44be-a653-2ca26a08cfb4 req-b3dca46a-5cee-47de-862e-cc5d3df6ca68 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.359113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-a2375be6-0682-44be-a653-2ca26a08cfb4 req-b3dca46a-5cee-47de-862e-cc5d3df6ca68 service nova] Creating event network-vif-deleted:b63e5ca3-4866-40d2-815c-ec29fddad4bf for instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 on hv-cinder-85426 Aug 30 04:35:10.365950 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-a2375be6-0682-44be-a653-2ca26a08cfb4 req-b3dca46a-5cee-47de-862e-cc5d3df6ca68 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046368 Aug 30 04:35:10.366249 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 403/780] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:10.723650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:10.724611 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:10.734138 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.734945 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.735721 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.736966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.737757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.738511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.801733 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.802635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.803623 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.804475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'fault' on Instance uuid ba6cd6eb-b345-40aa-9997-edd0e1d35089 {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:10.865654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:10.866743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:10.873967 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.874426 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.874868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.875621 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.876134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.876543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.886041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:10.899240 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c1daf0ae-bb67-45d6-a276-33aa746f1ed3 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1312 microversion: 2.1 time: 0.179026 Aug 30 04:35:10.900610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 378/781] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:10 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:10.911043 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:11.054636 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4b8a5b46-cf06-480d-80d1-8d18573d08c4 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 204 len: 0 microversion: 2.1 time: 0.193599 Aug 30 04:35:11.055686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 404/782] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:10 2022] DELETE /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:11.070524 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:11.072843 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:11.084784 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.085961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.086410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.087394 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.088269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.089029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.332635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:11.342636 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-62808b5c-3edc-40a6-adc4-2f37d582ed96 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1555 microversion: 2.1 time: 0.281617 Aug 30 04:35:11.343272 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 379/783] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:11 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:11.924087 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:11.925105 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:11.934481 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.934971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.935404 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.936222 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.936680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.937072 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.974501 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.974979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.975409 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.975873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'fault' on Instance uuid ba6cd6eb-b345-40aa-9997-edd0e1d35089 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:12.024627 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:12.034132 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-955cdeb3-9b4d-4da0-90e7-5aa74bc6a43e tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1312 microversion: 2.1 time: 0.115038 Aug 30 04:35:12.034914 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 405/784] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:11 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:12.371670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:12.372537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:12.380710 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:12.381207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:12.381637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:12.382392 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:12.382878 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:12.383298 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:12.569832 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:12.579386 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0d3b94b3-a43c-4ca5-8795-fbc1cc6c513e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1555 microversion: 2.1 time: 0.211780 Aug 30 04:35:12.580003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 380/785] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:12 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:13.057378 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:13.058006 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:13.067020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:13.068154 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:13.068934 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.070254 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:13.071028 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:13.071777 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.119770 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:13.122131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:13.122580 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.123086 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lazy-loading 'fault' on Instance uuid ba6cd6eb-b345-40aa-9997-edd0e1d35089 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:13.182018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589bd91dbf434099b15ed7a8680f93bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09f049bcfa64015bf7495ae9ec2924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:13.196288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-87eb695c-962e-4a63-b877-dda824789b7d tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 200 len: 1312 microversion: 2.1 time: 0.142930 Aug 30 04:35:13.197327 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 406/786] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:13 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:13.604203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:13.605008 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:13.612466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:13.612979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:13.613389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.614124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:13.614642 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:13.615822 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.810625 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:13.822786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a85cd7ce-9537-40df-b863-e1b1156656aa tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1555 microversion: 2.1 time: 0.224836 Aug 30 04:35:13.824051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 381/787] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:13 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:14.224577 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:14.225993 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] [instance: ba6cd6eb-b345-40aa-9997-edd0e1d35089] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:14.239403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.240781 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.242096 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.243424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.244576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.245599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.273121 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] HTTP exception thrown: Instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 could not be found. Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Request method failure captured: Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 HTTP/1.1 Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZI5wHVu63y0quaUniqRTR3Rdq3_hKasNXmOKcEjaFEPRz2Q6YV9t3NY4sLsy63qIsgRroIX5HqT2kuff3-AzB400MVTV919FNDOQso0tdigaOajD1MR1Coxjek0embcSMpp6HC91cX_nnjwfXU1h8FkL2oaltPTQuUPtBh1n9Su2tc Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:35:14.275229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/b09f049bcfa64015bf7495ae9ec2924a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: b09f049bcfa64015bf7495ae9ec2924a Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-56671497 Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 589bd91dbf434099b15ed7a8680f93bb Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-56671497-project Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 could not be found. Aug 30 04:35:14.276819 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'ba6cd6eb-b345-40aa-9997-edd0e1d35089'} Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 could not be found. Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:14.277697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 could not be found. Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 could not be found. Aug 30 04:35:14.278913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:14.280021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] Returning 404 to user: Instance ba6cd6eb-b345-40aa-9997-edd0e1d35089 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:14.280021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8f56971c-4bad-4e6a-a37e-510a0cb8bab0 tempest-ServerRescueNegativeTestJSON-56671497 tempest-ServerRescueNegativeTestJSON-56671497-project] 10.222.0.91 "GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089" status: 404 len: 111 microversion: 2.1 time: 0.060696 Aug 30 04:35:14.281080 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 407/788] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:14 2022] GET /compute/v2.1/servers/ba6cd6eb-b345-40aa-9997-edd0e1d35089 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:14.518808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-8c83255b-bac7-464a-afd5-2af50e768d06 req-e9d29380-efd0-4b2c-8597-89f1e8bea5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9a6009-b7c3-4bec-9c1f-00487651ecbe", "name": "network-vif-deleted", "tag": "d13cb21f-376e-4f2b-9daf-472725dece64"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:14.533584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8c83255b-bac7-464a-afd5-2af50e768d06 req-e9d29380-efd0-4b2c-8597-89f1e8bea5f2 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.534261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8c83255b-bac7-464a-afd5-2af50e768d06 req-e9d29380-efd0-4b2c-8597-89f1e8bea5f2 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.534949 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8c83255b-bac7-464a-afd5-2af50e768d06 req-e9d29380-efd0-4b2c-8597-89f1e8bea5f2 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.555069 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-8c83255b-bac7-464a-afd5-2af50e768d06 req-e9d29380-efd0-4b2c-8597-89f1e8bea5f2 service nova] Creating event network-vif-deleted:d13cb21f-376e-4f2b-9daf-472725dece64 for instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe on hv-cinder-85426 Aug 30 04:35:14.562020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-8c83255b-bac7-464a-afd5-2af50e768d06 req-e9d29380-efd0-4b2c-8597-89f1e8bea5f2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049419 Aug 30 04:35:14.562841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 382/789] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:14.857153 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:14.858246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:14.881403 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.887133 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.887972 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.892103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.892919 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.893660 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.982425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.983263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.984076 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.984789 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lazy-loading 'fault' on Instance uuid ec9a6009-b7c3-4bec-9c1f-00487651ecbe {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:15.064287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9817cf82004a5e824a93d1b3ede5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2baee55e704f8cbcf73b9bab63bd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:15.073445 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7538ce69-4593-4698-b663-c8b7b2c65645 tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 200 len: 1349 microversion: 2.1 time: 0.223992 Aug 30 04:35:15.074032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 408/790] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:14 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 1349 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:16.108579 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:16.110339 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] [instance: ec9a6009-b7c3-4bec-9c1f-00487651ecbe] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:16.119809 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:16.120488 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:16.120953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:16.121757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:16.122539 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:16.123005 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:16.139143 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] HTTP exception thrown: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe could not be found. Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Request method failure captured: Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe HTTP/1.1 Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKuO5XPVoYfpjVHL2DhH5R1cqm8cXFIB_-6N4yUkOLklkNcmhgCH1UIygjuMO26_zr6howGAC34HkLNT65agasZCY0HBWebo_yH6OpR0ltarsV7iHUv3SRkb3qi9O_SCGb3AoZjK_OipiIVs9vytpIQRxcDW9KBy-Qqm9lNSAMZdfw Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: da2baee55e704f8cbcf73b9bab63bd9a Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-TestMinimumBasicScenario-689611478 Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:35:16.140908 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/da2baee55e704f8cbcf73b9bab63bd9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-TestMinimumBasicScenario-689611478 Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: da2baee55e704f8cbcf73b9bab63bd9a Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-TestMinimumBasicScenario-689611478 Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-TestMinimumBasicScenario-689611478-project Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: ba9817cf82004a5e824a93d1b3ede5cb Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-TestMinimumBasicScenario-689611478-project Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe could not be found. Aug 30 04:35:16.142415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'ec9a6009-b7c3-4bec-9c1f-00487651ecbe'} Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe could not be found. Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:16.143270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe could not be found. Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe could not be found. Aug 30 04:35:16.144499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:16.145563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Returning 404 to user: Instance ec9a6009-b7c3-4bec-9c1f-00487651ecbe could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:16.145563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-de1c4122-a94d-43a6-a12f-6340a0f2fbba tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe" status: 404 len: 111 microversion: 2.1 time: 0.040238 Aug 30 04:35:16.147903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 383/791] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:16 2022] GET /compute/v2.1/servers/ec9a6009-b7c3-4bec-9c1f-00487651ecbe => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:16.156683 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-807bc223-cad0-4b69-8ff2-c7589c6df66e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] Calling method '.version_select at 0x7f24ec460700>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:16.192676 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-807bc223-cad0-4b69-8ff2-c7589c6df66e tempest-TestMinimumBasicScenario-689611478 tempest-TestMinimumBasicScenario-689611478-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1935935893" status: 202 len: 0 microversion: 2.1 time: 0.043263 Aug 30 04:35:16.193765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 409/792] 10.222.0.91 () {58 vars in 1272 bytes} [Tue Aug 30 04:35:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1935935893 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:26.110644 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:26.112091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:26.118474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:26.132193 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:26.143868 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.146054 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.146504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.147250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.149460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.152576 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.216956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e0577eab-2a61-43b2-9927-abd0ebf4d199 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/ips" status: 200 len: 146 microversion: 2.1 time: 0.570998 Aug 30 04:35:26.217975 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 384/793] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:25 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/ips => generated 146 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:26.519384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:26.523428 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:26.533853 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:26.535738 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:26.568938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.569945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.570793 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.572453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.573654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.574909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.644171 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lazy-loading 'flavor' on Instance uuid c0eee000-87fc-45aa-bb83-92fa9f5b5fab {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:26.948052 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-39bd4fb9-81e4-4751-8be5-9a536e340407 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "POST /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab/action" status: 202 len: 0 microversion: 2.1 time: 0.434376 Aug 30 04:35:26.949320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 410/794] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:35:26 2022] POST /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:26.961979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:26.962932 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:26.970951 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.971768 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.972490 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.973615 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.974317 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.975377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:27.251516 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:27.268466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4461ce8c-8007-41e0-8318-3e4d53b4088a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.312581 Aug 30 04:35:27.269825 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 385/795] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:26 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:27.984618 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61e5d9dd-d71b-480d-b63b-d6e9d73dfd3d"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:27.988203 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:27.996147 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:27.997030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:27.997640 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:27.998579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:27.999218 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.006210 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.324042 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:28.332804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:28.352664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.356219 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.357609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.358847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.359495 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.360665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.685947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:28.697774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-164c8eae-dbd0-4d12-aec5-7ca9ca09976c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.386059 Aug 30 04:35:28.698145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 386/796] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:28 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:28.713901 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ddbc0063-2266-4837-9a95-e60152eb63d2 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733621 Aug 30 04:35:28.716025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 411/797] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:35:27 2022] POST /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:29.723263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.724487 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.749409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.751002 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.752970 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.754492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.755191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.755834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.033017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:30.057171 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-395d90df-7dbd-4323-a7a1-c50aedb9f6f1 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.339083 Aug 30 04:35:30.058596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 387/798] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:29 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:31.098909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.100288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:31.111323 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.112650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.113434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.114521 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.115084 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.115770 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.190150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.192717 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:31.200382 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.200722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.201152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.201868 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.202360 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.202707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.254465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c9ea5cb9-6f10-495b-a53a-4482d38e811d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070332 Aug 30 04:35:31.255978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 388/799] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:31 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:31.267989 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.268600 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:31.276124 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.276630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.277106 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.277916 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.278407 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.278840 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.312065 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:31.318421 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3e00c869-af4f-47b0-a58d-f07da1f58e27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/61e5d9dd-d71b-480d-b63b-d6e9d73dfd3d" status: 200 len: 194 microversion: 2.1 time: 0.054521 Aug 30 04:35:31.319451 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 389/800] 10.222.0.91 () {58 vars in 1413 bytes} [Tue Aug 30 04:35:31 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/61e5d9dd-d71b-480d-b63b-d6e9d73dfd3d => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:31.321758 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b2e94f70-7a17-483b-bec3-f2b10b2f4876 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.228931 Aug 30 04:35:31.322351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 412/801] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:31 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:32.353655 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:32.354595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:32.361861 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.362350 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.362770 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.363467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.364217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.364761 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.578688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:32.591335 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-49dcec70-b5b3-496f-9f2d-3c1c92fecb09 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.241281 Aug 30 04:35:32.592671 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 390/802] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:32 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:32.800904 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c06593e-2ee0-44a0-bc55-127c1bb7d709"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:32.805871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:32.816290 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.817149 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.818094 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.819332 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.820219 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.820968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.255768 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-15ff1b16-9338-4518-83b7-b7239af13ffb tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "POST /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457940 Aug 30 04:35:33.259869 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 413/803] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:35:32 2022] POST /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:33.628122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:33.629070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:33.650626 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.651486 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.652290 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.653542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.654374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.655155 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.906218 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:33.920129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-954945ad-a80a-4a90-b72d-9e1f5905f4b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.299133 Aug 30 04:35:33.932095 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 391/804] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:33 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:34.965144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:34.966041 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:34.973413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.974439 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.974636 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.975683 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.976194 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.976618 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.181912 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:35.193234 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-716905de-d037-4886-93b9-d8b40e2278a7 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.232951 Aug 30 04:35:35.194023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 414/805] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:34 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:35.605672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:35.609363 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:35.620321 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.621130 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.621855 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.623040 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.623795 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.624662 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.679773 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8af23043-ad0e-48e6-a525-16e90571c949 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.082204 Aug 30 04:35:35.680416 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 392/806] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:35 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:35.827066 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:35.827558 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:35.837047 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.837735 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.838145 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.838881 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.839339 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.840561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.890118 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9597a1d6-bfde-4b1c-af32-81c2de59ab52 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/61e5d9dd-d71b-480d-b63b-d6e9d73dfd3d" status: 200 len: 194 microversion: 2.1 time: 0.066940 Aug 30 04:35:35.890938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 415/807] 10.222.0.91 () {58 vars in 1413 bytes} [Tue Aug 30 04:35:35 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/61e5d9dd-d71b-480d-b63b-d6e9d73dfd3d => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:35.903688 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:35.904366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:35.916302 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.916302 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.916302 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.916854 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.917372 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.917977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.034492 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lazy-loading 'services' on Instance uuid 999dbbf6-840d-4eb7-ab9e-291b3de143cf {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:36.154663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-54e99ac7-9990-49e5-8e30-b2179f324b3f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/61e5d9dd-d71b-480d-b63b-d6e9d73dfd3d" status: 202 len: 0 microversion: 2.1 time: 0.255230 Aug 30 04:35:36.155191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 393/808] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:35:35 2022] DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/61e5d9dd-d71b-480d-b63b-d6e9d73dfd3d => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:35:36.221376 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:36.223584 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:36.236489 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.237828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.238809 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.240411 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.241779 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.243047 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.436931 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:36.446288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2898e8f5-6fed-4bf7-aca6-ad51948ceeab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.231800 Aug 30 04:35:36.446937 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 416/809] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:36 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:37.386374 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.387397 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.401030 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.401411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.403012 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.403836 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.404442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.405516 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.454188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3414b07a-9bfd-4351-8a5c-3a478bc20953 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/6c06593e-2ee0-44a0-bc55-127c1bb7d709" status: 200 len: 194 microversion: 2.1 time: 0.077508 Aug 30 04:35:37.455555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 394/810] 10.222.0.91 () {58 vars in 1413 bytes} [Tue Aug 30 04:35:37 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/6c06593e-2ee0-44a0-bc55-127c1bb7d709 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:37.474320 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.474725 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.475304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.475572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.486452 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.487320 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.488119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.488341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.489547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.490137 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.490516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.490730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.491474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.492569 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.493413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.494193 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.630831 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lazy-loading 'services' on Instance uuid 999dbbf6-840d-4eb7-ab9e-291b3de143cf {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:37.737923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:37.749084 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-96d43fb0-eeb8-43d7-a4af-60a36162c300 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.282401 Aug 30 04:35:37.749736 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 417/811] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:37 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:37.781269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a8eb6df7-3d7b-4e06-99c6-2e8c662e0b94 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/6c06593e-2ee0-44a0-bc55-127c1bb7d709" status: 202 len: 0 microversion: 2.1 time: 0.314178 Aug 30 04:35:37.782039 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 395/812] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:35:37 2022] DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments/6c06593e-2ee0-44a0-bc55-127c1bb7d709 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:38.772543 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:38.773184 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:38.780754 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:38.781248 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:38.781686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:38.782551 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:38.783051 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:38.783526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.016272 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:39.032374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-29e480cd-6e30-4f28-bda4-2bd1db76bc30 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.262540 Aug 30 04:35:39.032374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 418/813] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:38 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:39.053089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.055562 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.063031 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.063517 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.063992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.064693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.065146 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.065563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.113389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0295cb63-9a9a-4960-92e7-af6ec0542fde tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068548 Aug 30 04:35:39.114820 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 396/814] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:39 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:35:39.288188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.291200 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.297876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.298540 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.299065 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.300765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.301355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.301877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.365859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-44942377-d321-44fd-9b19-0ec77a0457dc tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083620 Aug 30 04:35:39.367196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 419/815] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:39 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:35:39.478381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.479378 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.487482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.488016 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.488461 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.489518 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.490268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.490777 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.519429 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:39.556757 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.557542 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.569871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.570936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.572223 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.573993 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.575109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.576243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.610814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-eab17269-8da8-474e-84e5-07cf24a14ab7 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/ips" status: 200 len: 152 microversion: 2.20 time: 0.062806 Aug 30 04:35:39.619984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 420/816] 10.222.0.91 () {60 vars in 1289 bytes} [Tue Aug 30 04:35:39 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/ips => generated 152 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:35:39.628154 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:39.686661 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e3e83e18-768c-48fe-be1a-9ed50f431439 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 204 len: 0 microversion: 2.1 time: 0.213148 Aug 30 04:35:39.687803 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 397/817] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:39 2022] DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:39.696915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.698002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.705491 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.705995 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.706429 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.707159 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.707651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.708335 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.937771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:39.952541 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d5dbfd2f-1e9e-4a1e-bc74-5728d4f37955 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1672 microversion: 2.1 time: 0.259926 Aug 30 04:35:39.953498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 421/818] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:39 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1672 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:40.072748 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:40.076173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:40.090674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.091338 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.091786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.092541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.093004 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.093523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.298216 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:40.309707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c7ada7c7-2cd5-4539-8f0a-6b135bcdc378 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.246654 Aug 30 04:35:40.310690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 398/819] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:40 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:40.983651 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:40.984475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:40.995502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.996582 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.997624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.999010 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:41.000130 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:41.001027 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:41.009591 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:41.217680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:41.227859 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4203a355-31fc-4200-ba92-1de168dbcc63 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1672 microversion: 2.1 time: 0.249022 Aug 30 04:35:41.228609 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 422/820] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:40 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1672 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:41.351507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:41.352643 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:41.364508 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:41.365464 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:41.366258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:41.367448 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:41.368304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:41.369050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:41.874875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:41.885707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-86051487-8e64-4e2c-b69a-2657b2e8eeee tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.541665 Aug 30 04:35:41.886906 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 399/821] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:41 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:42.013576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:42.014106 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:42.021936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.022618 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.023110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.023987 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.024528 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.025131 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.055532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lazy-loading 'flavor' on Instance uuid 52ff6f54-9208-47dc-a7d6-8bbd2f361078 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:42.252460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:42.253055 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:42.264850 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.265647 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.266138 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.271325 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.272217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.272729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.366112 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4b38d257-c7a4-4c63-a722-14a7052907e8 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/action" status: 202 len: 0 microversion: 2.20 time: 0.361307 Aug 30 04:35:42.367760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 423/822] 10.222.0.91 () {62 vars in 1319 bytes} [Tue Aug 30 04:35:42 2022] POST /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:42.387117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:42.388983 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:42.405010 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.407141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.407948 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.410752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.413361 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.414601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.637500 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:42.657480 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-961def15-735a-4626-8848-e3a2927000d7 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1672 microversion: 2.1 time: 0.410175 Aug 30 04:35:42.658347 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 400/823] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:42 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1672 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:42.741356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:42.755447 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:42.758202 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:42.759708 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-7712666e-f921-408c-af9a-65e646ea210d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.383454 Aug 30 04:35:42.760900 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 424/824] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:42 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:42.925440 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:42.927189 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:42.939855 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.940902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.941750 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.943280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.944757 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.945584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.213913 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:43.226070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-29bfef8d-6b11-4a77-9054-49023485f4ec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.306787 Aug 30 04:35:43.227089 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 401/825] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:42 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:43.691574 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:43.693825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:43.710418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.711280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.711891 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.712828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.713474 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.714230 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.737937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-89c77e1c-1a0b-46df-950a-8c46d0a6b4b5 req-9e50b76f-9e7d-4e51-ade7-f440568d4154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999dbbf6-840d-4eb7-ab9e-291b3de143cf", "name": "network-vif-deleted", "tag": "b4084b0c-b4e3-4380-b521-ec05e08e1f79"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:43.762563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-89c77e1c-1a0b-46df-950a-8c46d0a6b4b5 req-9e50b76f-9e7d-4e51-ade7-f440568d4154 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.763571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-89c77e1c-1a0b-46df-950a-8c46d0a6b4b5 req-9e50b76f-9e7d-4e51-ade7-f440568d4154 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.765022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-89c77e1c-1a0b-46df-950a-8c46d0a6b4b5 req-9e50b76f-9e7d-4e51-ade7-f440568d4154 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.792157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-89c77e1c-1a0b-46df-950a-8c46d0a6b4b5 req-9e50b76f-9e7d-4e51-ade7-f440568d4154 service nova] Creating event network-vif-deleted:b4084b0c-b4e3-4380-b521-ec05e08e1f79 for instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf on hv-cinder-85426 Aug 30 04:35:43.802658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-89c77e1c-1a0b-46df-950a-8c46d0a6b4b5 req-9e50b76f-9e7d-4e51-ade7-f440568d4154 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072694 Aug 30 04:35:43.804658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 402/826] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:43.821962 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:43.823735 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:43.839029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.840367 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.841530 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.843725 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.844935 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.846168 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.867774 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:43.887104 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-155ab0c0-5a84-4d14-aceb-81e32dfee2f8 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1605 microversion: 2.1 time: 0.199279 Aug 30 04:35:43.910997 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 425/827] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:43 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:44.084790 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.098976 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.101593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.102838 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-060a75ed-605c-452b-89cf-1924dc2c4e5d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.295944 Aug 30 04:35:44.103495 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 403/828] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:43 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:44.255825 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:44.257263 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:44.267408 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:44.268296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:44.269023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:44.270301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:44.271324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:44.272111 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:44.513380 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.524362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-32eb66eb-956b-44cc-aa35-ead1be6b881c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.276659 Aug 30 04:35:44.525374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 426/829] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:44 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:44.925405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:44.927497 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:44.941288 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:44.942085 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:44.943432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:44.944996 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:44.946195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:44.947295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.021606 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.022918 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.023882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.024911 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.objects.instance [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lazy-loading 'fault' on Instance uuid 999dbbf6-840d-4eb7-ab9e-291b3de143cf {{(pid=120847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:45.126082 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a872454622d41ce9462890af418182d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1638b6f183134b83b87ce6f2eb995d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.142821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-40614ada-4803-4c61-b0cb-97ee5a95a074 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 200 len: 1326 microversion: 2.1 time: 0.225658 Aug 30 04:35:45.144341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 404/830] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:44 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 1326 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:45.153666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:45.153666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:45.173389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.176324 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.177190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.178498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.179109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.179551 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.465055 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.474849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.476541 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.478273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1b60774a-86e9-409c-b7bb-307b96a950c5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.338856 Aug 30 04:35:45.478928 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 427/831] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:45 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:45.560234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:45.560771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:45.569235 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.569902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.570588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.571325 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.571778 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.572231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.803252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.818452 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-496a362a-e343-441b-ba70-81a28107db0a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.261961 Aug 30 04:35:45.819114 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 405/832] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:45 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:46.170500 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.171397 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:46.179989 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.180495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.180999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.181799 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.182374 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.182745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.199032 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] HTTP exception thrown: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Request method failure captured: Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf HTTP/1.1 Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZI6JUiaoREI_8V36tCbgjztSk1aIRMyKtcsoKo6bBl_OM5D8QQY58ZVaC9YAuojDkNp1FprMPFFI5yU1GmfDnl0iQpB84V_QbndUoJjKqbV6yivRwDqoCiCGiH7vhOnfvH2gkSGIWeoDve6xZrIDrTlSnV7Oyt2p813atr_KTk0ZZg Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:35:46.200909 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 9a872454622d41ce9462890af418182d Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:46.202436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '999dbbf6-840d-4eb7-ab9e-291b3de143cf'} Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:46.203314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:46.204745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:46.206165 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Returning 404 to user: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:46.206165 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-408c486d-03c0-4407-a5b6-00b102221d2f tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 404 len: 111 microversion: 2.1 time: 0.036854 Aug 30 04:35:46.206165 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 428/833] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:46 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:46.214407 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4da41d97-fe38-4f82-ba27-fbed0ee6ac49 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '.version_select at 0x7f24ec3a00d0>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.238624 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4da41d97-fe38-4f82-ba27-fbed0ee6ac49 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74073869" status: 202 len: 0 microversion: 2.1 time: 0.029040 Aug 30 04:35:46.239218 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 406/834] 10.222.0.91 () {58 vars in 1215 bytes} [Tue Aug 30 04:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74073869 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:46.503573 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.504220 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:46.514160 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.514726 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.515188 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.516021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.516494 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.517201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.777170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:46.786323 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:46.788071 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:46.791840 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1818434b-4cdf-4674-b2a3-40196c83c6a9 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.290529 Aug 30 04:35:46.793343 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 429/835] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:46 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:46.846929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.847645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:46.854466 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.855087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.855601 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.856342 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.856799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.857213 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.024178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:47.034811 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cfef4074-5d2f-4226-a366-301ee9f8a5be tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1508 microversion: 2.1 time: 0.191805 Aug 30 04:35:47.035509 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 407/836] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:46 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:47.074688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:47.075728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:47.084906 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.085576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.086085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.086901 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.087468 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.088141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.128113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120846) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:35:47.245831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e620e6f9-d7b8-4427-88c8-41732652f566 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "POST /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab/action" status: 202 len: 0 microversion: 2.1 time: 0.177883 Aug 30 04:35:47.246761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 430/837] 10.222.0.91 () {60 vars in 1278 bytes} [Tue Aug 30 04:35:47 2022] POST /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:47.260447 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:47.261676 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:47.276431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.277319 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.278090 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.279313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.280148 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.280889 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.470866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:47.481953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c6f20b7d-6037-4750-9daa-1153305de5fe tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1516 microversion: 2.1 time: 0.229216 Aug 30 04:35:47.482886 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 408/838] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:47 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:47.826367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:47.827329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:47.838475 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.839243 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.840583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.842458 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.843271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.844031 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.063616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.081095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.085198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.087537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-642b8d12-5439-45bf-acb7-0af92bbd67cf tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.265533 Aug 30 04:35:48.089478 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 431/839] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:47 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:48.507945 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:48.509150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:48.517718 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.518489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.519079 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.519965 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.520570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.521209 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.790612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:48.791482 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:48.804509 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.805355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.806101 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.807607 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.808665 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.809629 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.874736 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-64904eda-74e1-4efb-83fe-5fd5a8c19706 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/ips" status: 200 len: 151 microversion: 2.1 time: 0.091509 Aug 30 04:35:48.876627 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 432/840] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:48 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/ips => generated 151 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:48.955007 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.975432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b69a7d9d-5455-4a35-9845-5b32e73f59c5 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1518 microversion: 2.1 time: 0.471612 Aug 30 04:35:48.979279 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 409/841] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:48 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1518 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:49.130528 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:49.131981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.139847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.140500 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.141002 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.141809 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.142274 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.142697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.283248 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-6efc9730-31c6-4607-b7fa-1b80cfe91347 req-fa91bc05-2fa9-4ba1-a528-9bf459a96849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eee000-87fc-45aa-bb83-92fa9f5b5fab", "name": "network-vif-unplugged", "status": "completed", "tag": "543dac3a-e946-4cd1-8a32-b40f01459925"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:49.329835 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-6efc9730-31c6-4607-b7fa-1b80cfe91347 req-fa91bc05-2fa9-4ba1-a528-9bf459a96849 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.331303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-6efc9730-31c6-4607-b7fa-1b80cfe91347 req-fa91bc05-2fa9-4ba1-a528-9bf459a96849 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.331781 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-6efc9730-31c6-4607-b7fa-1b80cfe91347 req-fa91bc05-2fa9-4ba1-a528-9bf459a96849 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.365049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-6efc9730-31c6-4607-b7fa-1b80cfe91347 req-fa91bc05-2fa9-4ba1-a528-9bf459a96849 service nova] Creating event network-vif-unplugged:543dac3a-e946-4cd1-8a32-b40f01459925 for instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab on hv-cinder-85426 Aug 30 04:35:49.384607 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-6efc9730-31c6-4607-b7fa-1b80cfe91347 req-fa91bc05-2fa9-4ba1-a528-9bf459a96849 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.363564 Aug 30 04:35:49.388116 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 433/842] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:49.472448 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:49.491150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:49.495729 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:49.499272 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b2e49f0e-84fe-4165-9170-5a874565dc37 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.376638 Aug 30 04:35:49.501225 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 410/843] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:49 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:49.572273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:49.572273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.580157 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.580771 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.581393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.582266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.582842 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.583974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.601435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] HTTP exception thrown: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Request method failure captured: Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf HTTP/1.1 Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZI6JUiaoREI_8V36tCbgjztSk1aIRMyKtcsoKo6bBl_OM5D8QQY58ZVaC9YAuojDkNp1FprMPFFI5yU1GmfDnl0iQpB84V_QbndUoJjKqbV6yivRwDqoCiCGiH7vhOnfvH2gkSGIWeoDve6xZrIDrTlSnV7Oyt2p813atr_KTk0ZZg Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:35:49.603514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 9a872454622d41ce9462890af418182d Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.605268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '999dbbf6-840d-4eb7-ab9e-291b3de143cf'} Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:49.606312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.607882 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.610611 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Returning 404 to user: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:49.610611 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-18ec8e63-df0d-4b71-89ef-7c450cf9a56c tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 404 len: 111 microversion: 2.1 time: 0.042887 Aug 30 04:35:49.616410 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 434/844] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:49 2022] DELETE /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:49.624134 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:49.624947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 999dbbf6-840d-4eb7-ab9e-291b3de143cf] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.634925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.635467 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.635995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.636840 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.637327 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.637956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.655829 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] HTTP exception thrown: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Request method failure captured: Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf HTTP/1.1 Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI6JUiaoREI_8V36tCbgjztSk1aIRMyKtcsoKo6bBl_OM5D8QQY58ZVaC9YAuojDkNp1FprMPFFI5yU1GmfDnl0iQpB84V_QbndUoJjKqbV6yivRwDqoCiCGiH7vhOnfvH2gkSGIWeoDve6xZrIDrTlSnV7Oyt2p813atr_KTk0ZZg Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:35:49.658954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 9a872454622d41ce9462890af418182d Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.660362 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '999dbbf6-840d-4eb7-ab9e-291b3de143cf'} Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:49.661341 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. Aug 30 04:35:49.668786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:49.670864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Returning 404 to user: Instance 999dbbf6-840d-4eb7-ab9e-291b3de143cf could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:49.670864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-cc534ec2-0304-4e53-8c5b-49b433e15ed5 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf" status: 404 len: 111 microversion: 2.1 time: 0.044578 Aug 30 04:35:49.670864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 411/845] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:49 2022] GET /compute/v2.1/servers/999dbbf6-840d-4eb7-ab9e-291b3de143cf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:50.020419 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:50.021443 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:50.029950 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.030510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.031057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.032444 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.033271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.034034 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.251021 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.260773 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f958aba0-a391-4a0f-8869-793fcfd0ceab tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1574 microversion: 2.1 time: 0.245595 Aug 30 04:35:50.261487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 435/846] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:50 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:50.526172 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:50.526914 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:50.535056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.535678 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.536307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.537475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.538150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.539496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.547329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc3cc867-ef2b-4e40-9bb5-81d4040d6416"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:50.551226 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:50.561393 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.562182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.562868 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.564026 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.564775 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.565487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.776484 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.794248 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.797868 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.801087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-35f97025-2f0f-4965-98e9-ea75e68ab33d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.279617 Aug 30 04:35:50.802093 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 412/847] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:50 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:50.907966 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:50.908577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:50.917017 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.917636 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.918152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.919075 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.919614 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.920170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.939774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] HTTP exception thrown: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Request method failure captured: Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: DELETE /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 HTTP/1.1 Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI6JUiaoREI_8V36tCbgjztSk1aIRMyKtcsoKo6bBl_OM5D8QQY58ZVaC9YAuojDkNp1FprMPFFI5yU1GmfDnl0iQpB84V_QbndUoJjKqbV6yivRwDqoCiCGiH7vhOnfvH2gkSGIWeoDve6xZrIDrTlSnV7Oyt2p813atr_KTk0ZZg Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:35:50.941981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 9a872454622d41ce9462890af418182d Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:50.943781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '9a566046-e7ae-47bc-bba8-3875c0ef4fa9'} Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:50.944574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:50.945753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:50.946977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Returning 404 to user: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:50.946977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-10049189-e68b-4c32-8c43-a11bad37ca27 tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 404 len: 111 microversion: 2.1 time: 0.040625 Aug 30 04:35:50.946977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 413/848] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:50 2022] DELETE /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:50.955169 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:50.956005 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] [instance: 9a566046-e7ae-47bc-bba8-3875c0ef4fa9] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:50.967727 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.968223 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.968733 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.969600 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.970061 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.970485 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.998022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] HTTP exception thrown: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Request method failure captured: Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 HTTP/1.1 Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI6JUiaoREI_8V36tCbgjztSk1aIRMyKtcsoKo6bBl_OM5D8QQY58ZVaC9YAuojDkNp1FprMPFFI5yU1GmfDnl0iQpB84V_QbndUoJjKqbV6yivRwDqoCiCGiH7vhOnfvH2gkSGIWeoDve6xZrIDrTlSnV7Oyt2p813atr_KTk0ZZg Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:35:51.000609 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/1638b6f183134b83b87ce6f2eb995d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: 1638b6f183134b83b87ce6f2eb995d7a Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818900164 Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 9a872454622d41ce9462890af418182d Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeTestJSON-1818900164-project Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:51.002366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '9a566046-e7ae-47bc-bba8-3875c0ef4fa9'} Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:51.003195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. Aug 30 04:35:51.005534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.007667 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] Returning 404 to user: Instance 9a566046-e7ae-47bc-bba8-3875c0ef4fa9 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:51.007667 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-080c1999-81f3-445d-bd4d-4301ff66661d tempest-AttachVolumeTestJSON-1818900164 tempest-AttachVolumeTestJSON-1818900164-project] 10.222.0.91 "GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9" status: 404 len: 111 microversion: 2.1 time: 0.051653 Aug 30 04:35:51.007667 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 414/849] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:50 2022] GET /compute/v2.1/servers/9a566046-e7ae-47bc-bba8-3875c0ef4fa9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:51.286457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:51.287898 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:51.296185 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.296680 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.297322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.298039 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.298491 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.298916 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.460991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:51.476110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9fc39c56-bdf8-4ece-9107-b9fbd641667c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935059 Aug 30 04:35:51.487824 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:51.497419 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 436/850] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:35:50 2022] POST /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments => generated 194 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:51.509113 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9e6ea7f7-4727-4177-aa58-29ec35e34c88 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1574 microversion: 2.1 time: 0.227073 Aug 30 04:35:51.510985 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 415/851] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:51 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:51.833780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:51.835079 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:51.847358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.848220 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.848970 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.850296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.850974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.851709 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.196498 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:52.210048 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:52.212682 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:52.214379 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d075862a-ebdd-483c-9c17-202642c2e571 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.391393 Aug 30 04:35:52.216198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 437/852] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:51 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:52.536088 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:52.537866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:52.557720 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.558571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.559297 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.560535 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.561363 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.562629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.784299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:52.795847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-19a9f8d5-6203-48b7-8a46-241ae82a228b tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1574 microversion: 2.1 time: 0.265851 Aug 30 04:35:52.796902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 416/853] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:52 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1574 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:53.247688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:53.249908 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:53.261609 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.262846 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.263967 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.265493 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.266545 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.267617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.464627 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:53.487711 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:53.492225 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:53.495139 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-40269e47-3716-49e8-9bf7-bb57637b4e04 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.254488 Aug 30 04:35:53.498098 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 438/854] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:53 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:53.847233 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:53.848309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:53.877410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.878292 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.884837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.885233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc3cc867-ef2b-4e40-9bb5-81d4040d6416"}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:53.888825 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.892444 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.895797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.901566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:53.923150 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.927000 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.929137 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.932201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.933933 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.935037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.117352 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Invalid volume: volume bc3cc867-ef2b-4e40-9bb5-81d4040d6416 is already attached to instances: ae46ccaf-4960-42d3-b45a-77d43f25430c Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: POST /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments HTTP/1.1 Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 74 Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:35:54.121143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {"volumeAttachment": {"volumeId": "bc3cc867-ef2b-4e40-9bb5-81d4040d6416"}} Aug 30 04:35:54.122663 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Invalid volume: volume bc3cc867-ef2b-4e40-9bb5-81d4040d6416 is already attached to instances: ae46ccaf-4960-42d3-b45a-77d43f25430c Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'server_id': 'ae46ccaf-4960-42d3-b45a-77d43f25430c', 'body': {'volumeAttachment': {'volumeId': 'bc3cc867-ef2b-4e40-9bb5-81d4040d6416'}}} Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bc3cc867-ef2b-4e40-9bb5-81d4040d6416 is already attached to instances: ae46ccaf-4960-42d3-b45a-77d43f25430c Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.123464 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bc3cc867-ef2b-4e40-9bb5-81d4040d6416 is already attached to instances: ae46ccaf-4960-42d3-b45a-77d43f25430c Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.125268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bc3cc867-ef2b-4e40-9bb5-81d4040d6416 is already attached to instances: ae46ccaf-4960-42d3-b45a-77d43f25430c Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 400 to user: Invalid volume: volume bc3cc867-ef2b-4e40-9bb5-81d4040d6416 is already attached to instances: ae46ccaf-4960-42d3-b45a-77d43f25430c {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-30c74b5f-1e74-4a58-8a1f-28dcb2581a86 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.246735 Aug 30 04:35:54.131772 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 439/855] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:35:53 2022] POST /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments => generated 174 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:35:54.255296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:54.256544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:54.262116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:54.266366 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.266872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.267314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.268057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.268509 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.268930 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.270636 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:54.282108 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d988832e-a37c-44f5-ae13-4bada63897b4 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1574 microversion: 2.1 time: 0.447716 Aug 30 04:35:54.283690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 417/856] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:53 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1574 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:54.449577 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lazy-loading 'services' on Instance uuid ae46ccaf-4960-42d3-b45a-77d43f25430c {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:54.529105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:54.530295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:54.543992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.545343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.546410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.548090 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.549033 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.549783 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.572893 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bf181716-33a1-4690-9cdc-c18d2dcd4a9f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments/bc3cc867-ef2b-4e40-9bb5-81d4040d6416" status: 202 len: 0 microversion: 2.1 time: 0.325903 Aug 30 04:35:54.574441 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 440/857] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:35:54 2022] DELETE /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments/bc3cc867-ef2b-4e40-9bb5-81d4040d6416 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:54.584920 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:54.587805 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:54.596045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.598233 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.598955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.600024 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.600800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.601977 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.668201 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-2986b1a8-504f-468d-93c2-19db8819435b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088970 Aug 30 04:35:54.669604 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 441/858] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:54 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:54.850534 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:54.863468 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:54.866906 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:54.869006 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8a6721d0-21fb-4b1c-82bd-2121e24c5653 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.347749 Aug 30 04:35:54.870549 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 418/859] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:54 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:55.311238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:55.312360 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:55.331635 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-8794acbb-6f91-4a4c-9a7d-cdaab3ad8f10 req-60b8cb2b-ea3e-4016-99c4-4d5072d6f6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eee000-87fc-45aa-bb83-92fa9f5b5fab", "name": "network-vif-plugged", "status": "completed", "tag": "543dac3a-e946-4cd1-8a32-b40f01459925"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:55.335246 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.344309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.345389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.347025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.349563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.350485 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.366083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8794acbb-6f91-4a4c-9a7d-cdaab3ad8f10 req-60b8cb2b-ea3e-4016-99c4-4d5072d6f6dc service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.367009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8794acbb-6f91-4a4c-9a7d-cdaab3ad8f10 req-60b8cb2b-ea3e-4016-99c4-4d5072d6f6dc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.367778 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-8794acbb-6f91-4a4c-9a7d-cdaab3ad8f10 req-60b8cb2b-ea3e-4016-99c4-4d5072d6f6dc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.392020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-8794acbb-6f91-4a4c-9a7d-cdaab3ad8f10 req-60b8cb2b-ea3e-4016-99c4-4d5072d6f6dc service nova] Creating event network-vif-plugged:543dac3a-e946-4cd1-8a32-b40f01459925 for instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab on hv-cinder-85426 Aug 30 04:35:55.403956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-8794acbb-6f91-4a4c-9a7d-cdaab3ad8f10 req-60b8cb2b-ea3e-4016-99c4-4d5072d6f6dc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078660 Aug 30 04:35:55.406129 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 419/860] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:55.690264 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:55.694813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:55.708896 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.710728 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.712716 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.713799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.714648 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.715413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.772175 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-40e7ff0e-4c78-44b4-9faf-f8573ac70afa tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093012 Aug 30 04:35:55.772982 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 420/861] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:55 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:35:55.778869 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:55.793315 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-605102b1-a953-4007-900b-0c171d7211c2 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1574 microversion: 2.1 time: 0.490988 Aug 30 04:35:55.808668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 442/862] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:55 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1574 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:55.917562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:55.920644 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:55.926837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:55.931768 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:55.936673 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.937973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.939078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.940662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.941808 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.942873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.952656 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.953465 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.954194 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.972458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.973598 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.975604 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.012734 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:56.189156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9d442ecb-de47-4171-b7b8-16b701d107b5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 204 len: 0 microversion: 2.1 time: 0.278757 Aug 30 04:35:56.191093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 443/863] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:55 2022] DELETE /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:56.206885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:56.208287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:56.219681 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.222255 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.223512 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.226569 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.227747 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.229800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.458152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:56.479999 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:56.481683 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:56.483042 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0bbe9af5-ca07-417c-9e4b-193d7adaf421 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.590877 Aug 30 04:35:56.489417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 421/864] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:55 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:56.546729 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:56.576488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6b20a3f8-b2fe-43bd-9e2d-6e4b44421765 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1682 microversion: 2.1 time: 0.378493 Aug 30 04:35:56.579141 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 444/865] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:56 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1682 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:56.829842 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:56.831876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:56.843395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:56.852959 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.853850 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.854615 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.855829 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.857771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.858481 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.207265 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:57.219823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8cc19543-d1cf-4541-9b11-0f6eebb5a849 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1574 microversion: 2.1 time: 0.396388 Aug 30 04:35:57.221377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 422/866] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:56 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1574 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:57.540518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:57.543351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:57.548125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:57.555405 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.556234 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.557012 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.558311 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.559073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.559805 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.600902 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:57.601761 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:57.609291 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.609783 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.610217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.611120 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.611570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.612010 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.815877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:57.832341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:57.832502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:57.833384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:57.836018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d9d21df8-9202-43be-8a36-6a774738ec32 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.310119 Aug 30 04:35:57.837442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 445/867] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:57 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:57.859403 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-789334ea-be1f-446a-8812-d384f167cac4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1682 microversion: 2.1 time: 0.262757 Aug 30 04:35:57.861052 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 423/868] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:57 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:58.257744 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:58.258512 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:58.269309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.270117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.270830 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.272262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.273051 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.274010 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.484308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:58.498760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b6ea124c-5aa7-490d-bf13-623a5095df33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1574 microversion: 2.1 time: 0.246069 Aug 30 04:35:58.499818 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 446/869] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:58 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:58.881736 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:58.889247 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:58.897058 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:58.898753 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:58.912391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.913239 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.914177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.914956 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.915422 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.915895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.924511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.925903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.926760 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.928402 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.929618 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.930503 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:59.143104 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:59.164699 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-06e021a0-2d4d-4625-8ced-11822304f770 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1682 microversion: 2.1 time: 0.271999 Aug 30 04:35:59.176895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 447/870] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:58 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:59.182092 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:59.199841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:59.203457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:59.205986 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a18c8494-5198-49a2-b6d3-7d0a6f81195c tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1744 microversion: 2.20 time: 0.332439 Aug 30 04:35:59.207531 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 424/871] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:58 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1744 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:59.546896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:59.576165 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:59.595025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:59.595883 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:59.596698 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:59.597808 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:59.598289 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:59.598889 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:59.892074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:59.912948 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c44b0e1d-1aa6-4255-bea6-7b0edd5d6fec tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1561 microversion: 2.1 time: 0.381629 Aug 30 04:35:59.929214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 448/872] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:59 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1561 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:00.201947 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:00.203571 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:00.212412 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.213677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.214195 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.215063 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.215537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.215991 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.234477 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:00.235423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:00.248480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.250039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.252358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.253661 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.259691 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.260752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.569071 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:00.580389 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b99607bd-c7f5-4ec0-b36b-3460997c806b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1682 microversion: 2.1 time: 0.382938 Aug 30 04:36:00.581241 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 425/873] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:00 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1682 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:00.596469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:00.607978 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:00.609848 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:00.611232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-54cab0b9-972c-47b2-9c79-53d6fffcb00e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1744 microversion: 2.20 time: 0.382283 Aug 30 04:36:00.612238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 449/874] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:00 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1744 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:01.198059 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-5d9b96a2-2e8b-422d-ba20-db1d6f248281 req-1797a2cd-f27d-42ba-a319-3a8a4849ca8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae46ccaf-4960-42d3-b45a-77d43f25430c", "name": "network-vif-deleted", "tag": "59e04df4-f99f-4ee9-9e65-958642187f1c"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:01.217478 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5d9b96a2-2e8b-422d-ba20-db1d6f248281 req-1797a2cd-f27d-42ba-a319-3a8a4849ca8e service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.219273 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5d9b96a2-2e8b-422d-ba20-db1d6f248281 req-1797a2cd-f27d-42ba-a319-3a8a4849ca8e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.219968 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-5d9b96a2-2e8b-422d-ba20-db1d6f248281 req-1797a2cd-f27d-42ba-a319-3a8a4849ca8e service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.270243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-5d9b96a2-2e8b-422d-ba20-db1d6f248281 req-1797a2cd-f27d-42ba-a319-3a8a4849ca8e service nova] Creating event network-vif-deleted:59e04df4-f99f-4ee9-9e65-958642187f1c for instance ae46ccaf-4960-42d3-b45a-77d43f25430c on hv-cinder-85426 Aug 30 04:36:01.279035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-5d9b96a2-2e8b-422d-ba20-db1d6f248281 req-1797a2cd-f27d-42ba-a319-3a8a4849ca8e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085860 Aug 30 04:36:01.280900 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 426/875] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:01.614501 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:01.616557 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:01.630365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.633855 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.637762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.639335 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.642538 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.649453 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:01.651260 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:01.654792 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.669511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.669875 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.677627 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.684661 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.685779 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.687463 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.768095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.770656 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.772260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.772985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lazy-loading 'fault' on Instance uuid ae46ccaf-4960-42d3-b45a-77d43f25430c {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:36:01.847009 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:01.851287 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:01.858445 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-326c22f1-03dd-4c86-8cad-b915f9d011dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 200 len: 1330 microversion: 2.1 time: 0.249318 Aug 30 04:36:01.859726 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 450/876] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:01 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 1330 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:01.866063 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-90ec2330-630d-4ccf-8d11-b93b725aab68 req-76bdbbc2-0b9e-4a12-b95a-f201413e40ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ff6f54-9208-47dc-a7d6-8bbd2f361078", "name": "network-vif-plugged", "status": "completed", "tag": "8f9dcf42-2c92-4dfb-86be-a86c9029c626"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:01.878067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-90ec2330-630d-4ccf-8d11-b93b725aab68 req-76bdbbc2-0b9e-4a12-b95a-f201413e40ec service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.878895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-90ec2330-630d-4ccf-8d11-b93b725aab68 req-76bdbbc2-0b9e-4a12-b95a-f201413e40ec service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.879571 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-90ec2330-630d-4ccf-8d11-b93b725aab68 req-76bdbbc2-0b9e-4a12-b95a-f201413e40ec service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.910467 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-90ec2330-630d-4ccf-8d11-b93b725aab68 req-76bdbbc2-0b9e-4a12-b95a-f201413e40ec service nova] Creating event network-vif-plugged:8f9dcf42-2c92-4dfb-86be-a86c9029c626 for instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 on hv-cinder-85426 Aug 30 04:36:01.924078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-90ec2330-630d-4ccf-8d11-b93b725aab68 req-76bdbbc2-0b9e-4a12-b95a-f201413e40ec service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062767 Aug 30 04:36:01.924974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 451/877] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:02.286906 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:02.313327 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:02.315334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:02.317577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c126c46d-c871-4b78-b89f-cd07b0b5f497 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.673252 Aug 30 04:36:02.318787 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 427/878] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:01 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:02.901613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:02.903894 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:02.915979 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:02.917195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:02.918547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:02.920095 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:02.921177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:02.922163 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:02.950862 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c HTTP/1.1 Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:36:02.954497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:36:02.955973 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'ae46ccaf-4960-42d3-b45a-77d43f25430c'} Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:02.956756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:36:02.957985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:36:02.963756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:02.963756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8673bcd3-4508-4336-85f1-4a7a4a5c9f58 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 404 len: 111 microversion: 2.1 time: 0.064223 Aug 30 04:36:02.963756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 452/879] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:02 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:02.972898 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-12697dca-6e59-41aa-9106-60b701779031 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '.version_select at 0x7f24ec4e7d30>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:03.013433 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-12697dca-6e59-41aa-9106-60b701779031 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830910128" status: 202 len: 0 microversion: 2.1 time: 0.046390 Aug 30 04:36:03.014992 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 428/880] 10.222.0.91 () {58 vars in 1218 bytes} [Tue Aug 30 04:36:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830910128 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:36:03.354970 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:03.360275 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:03.403728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:03.413242 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:03.415514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:03.417371 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:03.418872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:03.419378 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:03.843230 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:03.862683 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:03.868479 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:03.872520 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8376ae4e-893e-46b1-8049-b5fc66e436c2 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.523717 Aug 30 04:36:03.876633 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 453/881] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:03 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:04.441439 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8149fe8f-5c7d-43bd-aa22-455e163c7bac tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: .version_select at 0x7f24ec440f70>, body: {"keypair": {"name": "tempest-keypair-1696485189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh1FtnoJMkLjJPfUozp3KXuDBAaM+MQvS0AcHXKmrI2aMiZnlQw8ZAOV5rbux9wz4wfOE8Cf3faNjb4yLXH12gSc4RtrlwWe0M5FlI08IpUQwphAWGOtNwEIXlXJQqW4Q=="}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:04.466812 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-8149fe8f-5c7d-43bd-aa22-455e163c7bac tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:04.476091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-8149fe8f-5c7d-43bd-aa22-455e163c7bac tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'key_pairs'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:04.517536 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8149fe8f-5c7d-43bd-aa22-455e163c7bac tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083378 Aug 30 04:36:04.518802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 429/882] 10.222.0.91 () {60 vars in 1159 bytes} [Tue Aug 30 04:36:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:04.937452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:04.937452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:04.947480 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:04.948240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:04.948630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:04.949418 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:04.949884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:04.950316 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:05.274215 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:05.285648 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:05.289063 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:05.290088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1afc8258-36a4-472c-b481-2e3ee536aa63 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.359196 Aug 30 04:36:05.291007 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 454/883] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:04 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:06.347866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:06.349892 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:06.376413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.380172 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.385213 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.386955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.389434 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.391313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.713441 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:06.729070 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:06.730911 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:06.732546 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-499e0128-4618-448c-a47d-0884f9352d1f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.400669 Aug 30 04:36:06.744220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 430/884] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:06 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:07.761510 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:07.762607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:07.792409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:07.793663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:07.794704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:07.796541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:07.797346 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:07.798489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:07.841527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1986376301", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0fa4781-7b10-40fd-9cd8-6b3044f7ba50"}], "security_groups": [{"name": "tempest-securitygroup--434751592"}], "key_name": "tempest-keypair-1696485189", "user_data": "}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:08.035081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] validate_networks() for [('a0fa4781-7b10-40fd-9cd8-6b3044f7ba50', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:36:08.154866 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:08.187234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:08.190708 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:08.202569 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-63484100-9f3f-4674-821e-59412c3b070e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.448036 Aug 30 04:36:08.223781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 431/885] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:07 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:08.776985 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:08.777406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:08.777885 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:08.778316 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:08.781878 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:08.797896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.801551 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.802792 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.804607 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.806963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.808971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.866549 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:08.874435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Getting quotas for user 5adb079fad6c41aca6a619a71a3b7c3a and project ec24ad0a529d4df7a32b62a1558fa7a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:08.901676 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:08.905267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:08.978085 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f9895409-6c33-41b5-866e-d0917fbaea76 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.369060 Aug 30 04:36:08.978789 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 455/886] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:36:08.992269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-94e08ddc-b464-416c-9f48-eef91ccea757 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:08.992893 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-94e08ddc-b464-416c-9f48-eef91ccea757 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:09.081693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-94e08ddc-b464-416c-9f48-eef91ccea757 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:09.102682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-94e08ddc-b464-416c-9f48-eef91ccea757 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1242 microversion: 2.1 time: 0.115752 Aug 30 04:36:09.116134 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 432/887] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:08 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1242 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:09.249411 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:09.253794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:09.268565 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:09.270813 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:09.271555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:09.272690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:09.274119 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:09.274720 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:09.553664 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:09.571537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:09.575482 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:09.578965 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6ab9659c-f193-46dc-aa5d-f8fec410e07b tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.334718 Aug 30 04:36:09.581004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 456/888] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:09 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:10.128910 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:10.130292 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:10.149295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.150130 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.150789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.151720 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.152210 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.152639 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.286105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:10.299096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-7f45fdaf-f849-4d4a-a9a9-eab450add98e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1238 microversion: 2.1 time: 0.174294 Aug 30 04:36:10.312073 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 433/889] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:10 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1238 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:10.606458 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:10.607806 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:10.628476 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.631165 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.632750 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.633815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.634899 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.636282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.873169 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:10.888117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:10.890256 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:10.892996 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8c1a26c2-56e9-4227-98ec-c23bcc483fc6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.290454 Aug 30 04:36:10.905314 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 457/890] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:10 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:11.325460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:11.326748 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:11.338791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:11.345243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:11.345977 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.347153 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:11.347833 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:11.348471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.545838 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:11.573583 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-142414ab-9345-410d-b06f-ed6cba8e8a10 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1302 microversion: 2.1 time: 0.253847 Aug 30 04:36:11.576979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 434/891] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:11 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1302 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:11.928179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:11.932826 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:11.984516 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:11.985409 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:11.989537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.990814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:12.001214 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:12.002382 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:12.432265 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:12.457997 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:12.462047 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:12.465152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-fd4a6583-31db-4d9a-b4cd-9c5622f3cadd tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.545205 Aug 30 04:36:12.490938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 458/892] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:11 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:12.613958 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:12.615228 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:12.633724 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:12.634686 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:12.635348 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:12.636436 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:12.640719 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:12.641479 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:12.811476 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:12.840545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-fcd767e1-6bfc-448f-8e21-2497d37d004e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1300 microversion: 2.1 time: 0.230085 Aug 30 04:36:12.844654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 435/893] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:12 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1300 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:13.523560 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:13.524277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:13.549998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:13.551064 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:13.551813 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:13.565176 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:13.567235 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:13.568143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:13.865693 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:13.866602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:13.877990 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:13.878540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:13.883672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:13.884574 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:13.885096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:13.885801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:14.020547 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:14.042277 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:14.047704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:14.061108 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-559cbc2f-b9c7-4d04-8a68-0b42c030c764 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.547985 Aug 30 04:36:14.062489 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 459/894] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:13 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:14.424428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:14.451580 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-acebd93a-d352-4042-8937-89112470f6dd tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.589722 Aug 30 04:36:14.453019 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 436/895] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:13 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:15.117256 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:15.118108 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:15.132195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.132992 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.133458 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.134210 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.134743 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.135204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.490307 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:15.507252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:15.509922 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:15.512622 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:15.515514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:15.517019 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-af9654f3-653e-4fa9-8775-645a43a7cbaa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.405213 Aug 30 04:36:15.517680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 460/896] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:15 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:15.523629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.527229 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.528102 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.531066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.533343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.534502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.617334 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-4f78e533-67b3-402c-9de5-503adedc6ed5 req-3e1b0daa-b080-4164-b20f-8f0a2874f2df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbab3525-5c37-4997-95db-931a3f260aed", "tag": "65b16c11-23ae-4d39-bd0e-89656267aade"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:15.645471 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4f78e533-67b3-402c-9de5-503adedc6ed5 req-3e1b0daa-b080-4164-b20f-8f0a2874f2df service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.646413 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4f78e533-67b3-402c-9de5-503adedc6ed5 req-3e1b0daa-b080-4164-b20f-8f0a2874f2df service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.649438 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-4f78e533-67b3-402c-9de5-503adedc6ed5 req-3e1b0daa-b080-4164-b20f-8f0a2874f2df service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.698747 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-4f78e533-67b3-402c-9de5-503adedc6ed5 req-3e1b0daa-b080-4164-b20f-8f0a2874f2df service nova] Creating event network-changed:65b16c11-23ae-4d39-bd0e-89656267aade for instance dbab3525-5c37-4997-95db-931a3f260aed on hv-cinder-85426 Aug 30 04:36:15.714872 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-4f78e533-67b3-402c-9de5-503adedc6ed5 req-3e1b0daa-b080-4164-b20f-8f0a2874f2df service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104063 Aug 30 04:36:15.717958 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 461/897] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:16.031303 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:16.049332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c72ddcea-812d-4ddf-bb16-8a13ab128943 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.547220 Aug 30 04:36:16.050650 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 437/898] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:15 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:16.567344 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:16.575579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:16.627607 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.629004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.630586 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:16.633333 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.634938 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.636049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:17.104515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:17.109410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:17.136991 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:17.137510 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:17.137960 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:17.138687 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:17.139329 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:17.140880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:17.216296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:17.259971 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:17.267796 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:17.271614 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5e563967-9001-4a97-94c8-e65f2b8649ef tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.712293 Aug 30 04:36:17.273526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 462/899] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:16 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:17.591536 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:17.616071 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=100 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:17.650703 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-982c8068-b6c3-4bf6-ac0c-9f9179022524 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.560974 Aug 30 04:36:17.653330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 438/900] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:17 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:18.315229 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:18.316617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:18.344439 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.345835 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.346991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.348688 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.351268 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.353309 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.716471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:18.722187 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:18.744946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.746324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.748602 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.750486 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.752204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.753275 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.792046 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:18.817078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:18.826099 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:18.834098 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ee8302ac-9a41-4f18-98ee-91a30deac5f4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.524192 Aug 30 04:36:18.839412 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 463/901] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:18 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:19.101138 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=6 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:19.159038 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:19.200038 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-8cc07070-ac0a-4fc4-9bc1-7fce03863b71 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.494685 Aug 30 04:36:19.201448 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 439/902] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:18 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:19.890866 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:19.892488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:19.897845 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:19.899305 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=6 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:19.921790 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:19.923031 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:19.925327 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:19.927950 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:19.930664 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:19.932450 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.228879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:20.230428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:20.252804 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:20.253821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:20.254666 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.258697 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:20.271299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:20.273878 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:20.274663 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.303376 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:20.317084 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:20.330690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-dbed8af3-6eaf-4c12-ae70-5ba8d38b877a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.453371 Aug 30 04:36:20.340353 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 464/903] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:19 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:20.772388 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:20.803383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-565a6b0c-d46e-4d25-9d2e-5912c73d4d77 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.579204 Aug 30 04:36:20.805313 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 440/904] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:20 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:21.400532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:21.402057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:21.417566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.418357 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.419593 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.422689 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.423528 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.424831 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.748443 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:21.782798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:21.786612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:21.791567 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f62f9a2f-9c8e-42f7-a8db-95d836622b59 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1739 microversion: 2.20 time: 0.394494 Aug 30 04:36:21.793756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 465/905] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:21 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1739 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:21.845170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:21.845916 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:21.862074 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-028eb0d6-67f0-43a4-bb4f-3335509de018 req-6c9615aa-450b-4a0c-8332-b6e22cc7a8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbab3525-5c37-4997-95db-931a3f260aed", "name": "network-vif-plugged", "status": "completed", "tag": "65b16c11-23ae-4d39-bd0e-89656267aade"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:21.868665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.872170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.874281 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.880104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.883615 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.885624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-028eb0d6-67f0-43a4-bb4f-3335509de018 req-6c9615aa-450b-4a0c-8332-b6e22cc7a8f4 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.885957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.886297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-028eb0d6-67f0-43a4-bb4f-3335509de018 req-6c9615aa-450b-4a0c-8332-b6e22cc7a8f4 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.887362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-028eb0d6-67f0-43a4-bb4f-3335509de018 req-6c9615aa-450b-4a0c-8332-b6e22cc7a8f4 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.901442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-028eb0d6-67f0-43a4-bb4f-3335509de018 req-6c9615aa-450b-4a0c-8332-b6e22cc7a8f4 service nova] Creating event network-vif-plugged:65b16c11-23ae-4d39-bd0e-89656267aade for instance dbab3525-5c37-4997-95db-931a3f260aed on hv-cinder-85426 Aug 30 04:36:21.914928 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-028eb0d6-67f0-43a4-bb4f-3335509de018 req-6c9615aa-450b-4a0c-8332-b6e22cc7a8f4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056526 Aug 30 04:36:21.916155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 466/906] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:22.206948 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:22.224123 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-64b85c65-938f-4046-9bdb-ff5f21bd8e65 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.382309 Aug 30 04:36:22.228472 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 441/907] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:21 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:22.841491 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:22.842689 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:22.855067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:22.855932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:22.856930 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:22.858216 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:22.858998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:22.859706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:23.250659 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:23.251989 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:23.262779 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:23.263728 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:23.264715 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:23.267187 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:23.268860 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:23.270235 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:23.315765 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:23.332046 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:23.334802 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:23.336913 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1fc29673-c7ee-429a-8d4e-ac365ce0d1db tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1721 microversion: 2.20 time: 0.505549 Aug 30 04:36:23.338078 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 467/908] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:22 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1721 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:23.556638 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:23.575657 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-57400d5e-3ddb-4174-a990-c7adfa48c70a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.332368 Aug 30 04:36:23.582957 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 442/909] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:23 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:24.365954 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:24.366795 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:24.377623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:24.378566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:24.379196 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:24.380294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:24.380884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:24.381337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:24.618553 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:24.622212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:24.647204 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:24.650442 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:24.653078 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:24.655983 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:24.657429 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:24.658669 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:24.701702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:24.720431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:24.724170 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:24.729486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8ca94a6b-8e6c-4fd0-a622-57842d8280b5 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1721 microversion: 2.20 time: 0.366525 Aug 30 04:36:24.745206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 468/910] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:24 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:24.988460 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:24.998205 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-19f0b58d-a52c-4758-8077-0fffb509e38c tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1367 microversion: 2.1 time: 0.389559 Aug 30 04:36:24.998903 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 443/911] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:24 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:25.674144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-d0ae5804-7768-4792-99bc-91687c97f313 req-182be20a-b1eb-41fa-955e-22b5128d6e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ff6f54-9208-47dc-a7d6-8bbd2f361078", "name": "network-vif-unplugged", "status": "completed", "tag": "8f9dcf42-2c92-4dfb-86be-a86c9029c626"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:25.690810 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d0ae5804-7768-4792-99bc-91687c97f313 req-182be20a-b1eb-41fa-955e-22b5128d6e46 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:25.692139 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d0ae5804-7768-4792-99bc-91687c97f313 req-182be20a-b1eb-41fa-955e-22b5128d6e46 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:25.694101 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-d0ae5804-7768-4792-99bc-91687c97f313 req-182be20a-b1eb-41fa-955e-22b5128d6e46 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:25.718998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-d0ae5804-7768-4792-99bc-91687c97f313 req-182be20a-b1eb-41fa-955e-22b5128d6e46 service nova] Creating event network-vif-unplugged:8f9dcf42-2c92-4dfb-86be-a86c9029c626 for instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 on hv-cinder-85426 Aug 30 04:36:25.730689 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-d0ae5804-7768-4792-99bc-91687c97f313 req-182be20a-b1eb-41fa-955e-22b5128d6e46 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061160 Aug 30 04:36:25.732659 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 469/912] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:25.778768 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:25.780387 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:25.790226 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:25.790961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:25.791697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:25.792676 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:25.793665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:25.794438 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.032943 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:26.035090 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:26.061185 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.062425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.066510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.069046 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.070518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.071572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.151761 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:26.181402 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:26.186660 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:26.190983 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-196c899e-5deb-471c-ae58-952ee368fb7f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1721 microversion: 2.20 time: 0.417142 Aug 30 04:36:26.193629 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 444/913] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:25 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1721 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:26.359779 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:26.376654 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-59576302-71d8-4d74-bd0a-6006b4ab6606 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1557 microversion: 2.1 time: 0.356809 Aug 30 04:36:26.378056 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 470/914] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:26 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1557 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:26.414877 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:26.416307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:26.440046 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.441216 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.442032 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.443776 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.444649 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.445404 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.590572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-96c2634c-ee99-42fd-a08e-2de08ee73582 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182574 Aug 30 04:36:26.591747 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 445/915] 10.222.0.91 () {58 vars in 1275 bytes} [Tue Aug 30 04:36:26 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:26.943454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1841122298", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "networks": [{"uuid": "78266cd5-97a4-411b-9c28-8b6408e0cbf0"}]}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:27.033103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] validate_networks() for [('78266cd5-97a4-411b-9c28-8b6408e0cbf0', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:36:27.231799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:27.234790 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:27.240357 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:27.262834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.263608 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.264202 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:27.265457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.266141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.266678 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:27.518200 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:27.529797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:27.531613 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:27.533219 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5a01e2a6-e6a3-4a1a-ad5f-86fbd11d877e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1724 microversion: 2.20 time: 0.315732 Aug 30 04:36:27.534056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 446/916] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:27 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:27.576046 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5577e33-8f88-4941-b292-68e3c0436d2b"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:27.580142 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:27.588242 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.588953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.589558 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:27.590385 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.590955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.591474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.172991 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:28.174008 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:28.176091 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:28.177889 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:28.179278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:28.184179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:28.218678 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.221370 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.229622 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.234193 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.235381 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.237505 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.292206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Getting quotas for project d2e1ae67fada4bd68398e3b997f7d40e. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:28.304425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Getting quotas for user 1204737db5754fbf995c3c5c6d71e5bb and project d2e1ae67fada4bd68398e3b997f7d40e. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:28.335238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:28.340481 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:28.362559 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d28ed32d-4cf5-4f21-8026-710a2956fc67 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.791991 Aug 30 04:36:28.364323 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 447/917] 10.222.0.91 () {62 vars in 1364 bytes} [Tue Aug 30 04:36:27 2022] POST /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-volume_attachments => generated 188 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:36:28.435871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f1064eb1-ac71-4cd7-845a-4be17bb9afe4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715212 Aug 30 04:36:28.449662 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 471/918] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:36:28.458207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-27eeca78-fee0-4195-b680-13041834c81f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:28.459420 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-27eeca78-fee0-4195-b680-13041834c81f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:28.634119 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-27eeca78-fee0-4195-b680-13041834c81f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:28.685314 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-27eeca78-fee0-4195-b680-13041834c81f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1214 microversion: 2.1 time: 0.227932 Aug 30 04:36:28.685314 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 448/919] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:28 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:28.703761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:28.705315 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:28.720877 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.722114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.722669 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.724360 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.725767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.726583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.764313 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=100 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:29.133289 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-50c22362-a9a2-4c06-b6bb-8a938840b3e0 req-a27b4b93-3c98-4c7a-90f5-620663c49e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbab3525-5c37-4997-95db-931a3f260aed", "tag": "65b16c11-23ae-4d39-bd0e-89656267aade"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:29.154001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-50c22362-a9a2-4c06-b6bb-8a938840b3e0 req-a27b4b93-3c98-4c7a-90f5-620663c49e90 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:29.155170 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-50c22362-a9a2-4c06-b6bb-8a938840b3e0 req-a27b4b93-3c98-4c7a-90f5-620663c49e90 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:29.156040 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-50c22362-a9a2-4c06-b6bb-8a938840b3e0 req-a27b4b93-3c98-4c7a-90f5-620663c49e90 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.183570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-50c22362-a9a2-4c06-b6bb-8a938840b3e0 req-a27b4b93-3c98-4c7a-90f5-620663c49e90 service nova] Creating event network-changed:65b16c11-23ae-4d39-bd0e-89656267aade for instance dbab3525-5c37-4997-95db-931a3f260aed on hv-cinder-85426 Aug 30 04:36:29.203414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-50c22362-a9a2-4c06-b6bb-8a938840b3e0 req-a27b4b93-3c98-4c7a-90f5-620663c49e90 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220728 Aug 30 04:36:29.223377 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 449/920] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:29.280250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3fa9ab22-484d-4d5b-a00e-489071f2261e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-volume_attachments/b5577e33-8f88-4941-b292-68e3c0436d2b" status: 202 len: 0 microversion: 2.20 time: 0.585253 Aug 30 04:36:29.283435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 472/921] 10.222.0.91 () {60 vars in 1457 bytes} [Tue Aug 30 04:36:28 2022] DELETE /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-volume_attachments/b5577e33-8f88-4941-b292-68e3c0436d2b => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:36:29.463841 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:29.466931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:29.495697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:29.496246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:29.496677 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.497596 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:29.498060 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:29.498486 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.718397 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:29.720284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:29.732346 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:29.734200 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:29.735238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.738685 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:29.740063 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:29.741191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.856141 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120847) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:36:29.931967 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:29.958505 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-dea49084-00e7-4509-b132-744633fcd71f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1210 microversion: 2.1 time: 0.247446 Aug 30 04:36:29.959670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 473/922] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:29 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1210 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:30.048631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2feacb89-4c3c-4975-8cd6-7258cca7e20a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "POST /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/action" status: 202 len: 0 microversion: 2.20 time: 0.615432 Aug 30 04:36:30.050771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 450/923] 10.222.0.91 () {62 vars in 1319 bytes} [Tue Aug 30 04:36:29 2022] POST /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:36:30.060678 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:30.061613 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:30.078572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:30.079384 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:30.085564 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:30.091459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:30.092730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:30.093830 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:30.485398 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:30.509473 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:30.513919 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:30.518286 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c60f8e90-4641-417b-99d4-090497829ffa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1672 microversion: 2.20 time: 0.461750 Aug 30 04:36:30.522454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 474/924] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:30 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1672 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:31.005436 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:31.007332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:31.017744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:31.018813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:31.020876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:31.022545 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:31.023504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:31.024411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:31.386482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:31.396346 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-bcb8132e-f39d-4240-97f7-cd7967e0b111 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1272 microversion: 2.1 time: 0.395248 Aug 30 04:36:31.396934 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 451/925] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:30 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1272 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:31.559311 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:31.560830 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:31.569500 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:31.571166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:31.571944 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:31.573424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:31.575250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:31.575990 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:31.836561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:31.854756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:31.858761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:31.861502 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4a2575a5-dc96-4fec-967c-5d8005fdb132 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1672 microversion: 2.20 time: 0.313516 Aug 30 04:36:31.862469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 475/926] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:31 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1672 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:32.433346 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:32.435410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:32.448101 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.448542 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.449179 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.450675 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.452166 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.453126 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.804283 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:32.819395 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2d01ed86-c237-4789-9d62-ff8499acffa6 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.393203 Aug 30 04:36:32.820744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 452/927] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:32 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:32.898770 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:32.899527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:32.907873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.908597 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.909048 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.909794 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.910254 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.910803 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:33.266212 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:33.283058 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:33.286533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:33.289780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-940c77de-33b0-466a-a1df-b1deccdab21f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.395616 Aug 30 04:36:33.291400 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 476/928] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:32 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:33.576815 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-766f12b4-aed3-451b-aeca-db100945e564 req-c05db089-f824-43c6-8538-a8ff384f317d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5acda76-5108-4ce1-b23f-7f34d5c08e2c", "tag": "0cdb351e-bba2-4b1b-9d12-5ab44825c77f"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:33.603417 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-766f12b4-aed3-451b-aeca-db100945e564 req-c05db089-f824-43c6-8538-a8ff384f317d service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.605322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-766f12b4-aed3-451b-aeca-db100945e564 req-c05db089-f824-43c6-8538-a8ff384f317d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:33.606390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-766f12b4-aed3-451b-aeca-db100945e564 req-c05db089-f824-43c6-8538-a8ff384f317d service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:33.652358 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-766f12b4-aed3-451b-aeca-db100945e564 req-c05db089-f824-43c6-8538-a8ff384f317d service nova] Creating event network-changed:0cdb351e-bba2-4b1b-9d12-5ab44825c77f for instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c on hv-cinder-85426 Aug 30 04:36:33.663330 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-766f12b4-aed3-451b-aeca-db100945e564 req-c05db089-f824-43c6-8538-a8ff384f317d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094870 Aug 30 04:36:33.664967 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 453/929] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:33.855955 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:33.857045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:33.865701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.866897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:33.867519 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:33.868477 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.869113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:33.869838 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:34.244786 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:34.260182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-92ecdba4-c2cd-478f-9f19-45963ecbc19b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.408788 Aug 30 04:36:34.260828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 477/930] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:33 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:34.328773 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:34.329491 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:34.337797 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:34.338306 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:34.339311 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:34.340599 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:34.341322 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:34.341871 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:34.371566 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:34.547511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:34.561645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:34.564999 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:34.567747 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-77ea3461-5df9-4c15-8ab8-db7b21e51254 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.243867 Aug 30 04:36:34.568937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 454/931] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:34 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:35.291414 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:35.292364 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:35.306454 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.307250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.308039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:35.309623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.310510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.311365 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:35.595503 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:35.596409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:35.606026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.606864 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.607502 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:35.609133 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.609867 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.610295 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:35.732515 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:35.745164 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d4c7da0f-361f-471b-b0d1-4f59e13f001d tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.459791 Aug 30 04:36:35.760329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 478/932] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:35 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:35.833570 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:35.847425 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:35.849684 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:35.852270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e9823f40-b645-4b2f-9bf4-169d5fee9ee1 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.262418 Aug 30 04:36:35.853441 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 455/933] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:35 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:36.779843 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:36.786290 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:36.800455 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:36.804759 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:36.805798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:36.807527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:36.811714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:36.817138 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:36.911287 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:36.925816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:36.947304 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:36.948547 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:36.954573 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:36.956235 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:36.957177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:36.958044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:37.422399 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:37.438165 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:37.442013 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:37.444714 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-464d11f6-c57d-48dc-bfdb-74d06bccc07a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.543653 Aug 30 04:36:37.446762 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 456/934] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:36 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:37.490739 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:37.502526 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0a96a1d3-3dfd-458f-9644-c1d056c80929 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.730608 Aug 30 04:36:37.515140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 479/935] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:36 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:38.491489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:38.493972 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:38.516281 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.523196 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.524041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.525707 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.538681 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.542982 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.554653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:38.557039 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:38.563600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:38.565153 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=6 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:38.578756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.580042 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.581108 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.582673 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.583835 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.585025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.663446 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:38.879612 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:38.897858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:38.900754 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:38.903381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b9efec7d-7fcb-47f1-807c-6fb8e4f0e687 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.418994 Aug 30 04:36:38.923961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 457/936] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:38 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:39.015139 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:39.032111 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-83792e36-f623-4433-8c60-d4105818bddf tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.493789 Aug 30 04:36:39.033690 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 480/937] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:38 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:39.802781 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-65e9058d-b227-4d60-9b21-e5b51b4045e1 req-cddcd2fc-8ec9-4de3-9a03-e10bb0651534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5acda76-5108-4ce1-b23f-7f34d5c08e2c", "name": "network-vif-plugged", "status": "completed", "tag": "0cdb351e-bba2-4b1b-9d12-5ab44825c77f"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:39.830946 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-65e9058d-b227-4d60-9b21-e5b51b4045e1 req-cddcd2fc-8ec9-4de3-9a03-e10bb0651534 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:39.831752 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-65e9058d-b227-4d60-9b21-e5b51b4045e1 req-cddcd2fc-8ec9-4de3-9a03-e10bb0651534 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:39.832791 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-65e9058d-b227-4d60-9b21-e5b51b4045e1 req-cddcd2fc-8ec9-4de3-9a03-e10bb0651534 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:39.853418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-65e9058d-b227-4d60-9b21-e5b51b4045e1 req-cddcd2fc-8ec9-4de3-9a03-e10bb0651534 service nova] Creating event network-vif-plugged:0cdb351e-bba2-4b1b-9d12-5ab44825c77f for instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c on hv-cinder-85426 Aug 30 04:36:39.862203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-65e9058d-b227-4d60-9b21-e5b51b4045e1 req-cddcd2fc-8ec9-4de3-9a03-e10bb0651534 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063903 Aug 30 04:36:39.863541 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 458/938] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:39.945920 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:39.947312 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:39.956088 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:39.956806 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:39.957434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:39.958431 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:39.959435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:39.960206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:40.057979 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:40.058952 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:40.074273 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:40.076653 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:40.077572 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:40.078444 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:40.078970 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:40.079420 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:40.253871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:40.274338 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:40.276609 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:40.278703 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-36e1a4d3-d099-43fa-8c6a-1fb2f119a53f tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.337377 Aug 30 04:36:40.280320 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 481/939] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:39 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:40.419367 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:40.429555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-edf7cab9-4f9e-48a3-b189-9822c31c9ae9 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.377755 Aug 30 04:36:40.436105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 459/940] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:40 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:41.311717 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:41.314433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:41.327740 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:41.328992 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:41.330023 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:41.331514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:41.332620 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:41.333997 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:41.470846 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:41.474927 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:41.525150 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:41.525727 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:41.526530 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:41.527802 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:41.528625 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:41.529332 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:41.744288 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:41.776273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:41.778539 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:41.779960 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8654913d-1661-4047-a93d-f6ae9494b7b4 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.477258 Aug 30 04:36:41.782886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 482/941] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:41 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:41.871282 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:41.888305 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c7b08044-17bc-410b-884f-71ad6864f5d4 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.434177 Aug 30 04:36:41.894806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 460/942] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:41 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:42.814153 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:42.822197 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:42.845908 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.846912 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.847668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.848894 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.849800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.850633 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.933007 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:42.933645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:42.955199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.955695 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.959378 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.963387 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.964044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.965177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.200395 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:43.210714 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:43.213152 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:43.214978 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8a2c410f-7618-44cf-b33c-8b10c3739db0 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.408119 Aug 30 04:36:43.237993 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 483/943] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:42 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:43.356325 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:43.366637 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-072e3077-1e06-4b0a-a189-629e3105022f tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.444552 Aug 30 04:36:43.380739 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 461/944] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:42 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:44.246391 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:44.248801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:44.261566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.263122 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.263854 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.265204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.266061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.267067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.395880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:44.397780 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:44.411285 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.413255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.414883 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.416697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.417890 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.418970 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.527219 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:44.540763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:44.542520 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:44.544283 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4404f4a7-dac0-4846-bb78-ff9e35527d62 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.306845 Aug 30 04:36:44.545380 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 484/945] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:44 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:44.655402 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:44.669511 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6cb9f70d-0076-4eaa-b639-ef5fe586df60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.281013 Aug 30 04:36:44.670577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 462/946] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:44 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:45.574778 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:45.575583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:45.585870 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:45.586667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:45.587293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:45.588190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:45.588946 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:45.589629 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:45.694915 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:45.696584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:45.709888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:45.710884 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:45.712145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:45.713807 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:45.714995 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:45.715668 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:45.767278 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:45.780537 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:45.782753 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:45.784132 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-579476b7-a8b9-4d0f-88bb-faf669b0194e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.215336 Aug 30 04:36:45.784708 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 485/947] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:45 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:45.911601 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:45.939789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d9ac83de-3381-4e10-8144-5810a9158b60 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.250950 Aug 30 04:36:45.940600 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 463/948] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:45 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:46.821144 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:46.822720 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:46.831858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.832518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.833024 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.834035 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.835390 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.835889 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.867730 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:46.982256 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:46.984098 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:46.995179 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.996114 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.996808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.997961 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.998852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.999526 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:47.046579 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:47.056629 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:47.058123 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:47.062981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-723f5213-f9a9-45a6-8943-2c4fa93601d6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.245547 Aug 30 04:36:47.062981 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 486/949] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:46 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:47.174491 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:47.200233 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-4649a64b-5a5f-4ad3-ba50-72289354c3d5 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1314 microversion: 2.1 time: 0.223588 Aug 30 04:36:47.201812 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 464/950] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:46 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:48.090871 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:48.092984 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:48.105884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.108285 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.109686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.111667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.113093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.113892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.236237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:48.237165 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:48.247333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.248390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.255324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.255324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.255324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.255324 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.414965 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:48.431168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:48.433109 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:48.434490 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c0dd64f7-bdb8-479c-b782-1d9673bbb4aa tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.352737 Aug 30 04:36:48.435460 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 487/951] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:48 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:48.504921 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:48.518349 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-51b97ee4-d084-477d-b39d-99b3bc42891b tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1496 microversion: 2.1 time: 0.286672 Aug 30 04:36:48.518949 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 465/952] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:48 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1496 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:49.477886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:49.479472 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:49.490273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:49.490273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:49.491387 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:49.491624 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:49.492495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:49.492914 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:49.747173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:49.765114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:49.770615 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:49.778230 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-5db4d2e1-aed3-4dff-900b-1a62d5d5c589 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.306401 Aug 30 04:36:49.779701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 488/953] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:49 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:49.866171 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-1e08d9a4-b634-408b-820a-90a044ae1639 req-341b1d36-aa93-4598-a6e0-855f968faeeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ff6f54-9208-47dc-a7d6-8bbd2f361078", "name": "network-vif-plugged", "status": "completed", "tag": "8f9dcf42-2c92-4dfb-86be-a86c9029c626"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:49.889422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-1e08d9a4-b634-408b-820a-90a044ae1639 req-341b1d36-aa93-4598-a6e0-855f968faeeb service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:49.890513 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-1e08d9a4-b634-408b-820a-90a044ae1639 req-341b1d36-aa93-4598-a6e0-855f968faeeb service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:49.891646 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-1e08d9a4-b634-408b-820a-90a044ae1639 req-341b1d36-aa93-4598-a6e0-855f968faeeb service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:49.918224 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-1e08d9a4-b634-408b-820a-90a044ae1639 req-341b1d36-aa93-4598-a6e0-855f968faeeb service nova] Creating event network-vif-plugged:8f9dcf42-2c92-4dfb-86be-a86c9029c626 for instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 on hv-cinder-85426 Aug 30 04:36:49.931289 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-1e08d9a4-b634-408b-820a-90a044ae1639 req-341b1d36-aa93-4598-a6e0-855f968faeeb service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075086 Aug 30 04:36:49.932823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 466/954] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:50.819115 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:50.821406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:50.834914 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:50.835749 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:50.836886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:50.838045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:50.838793 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:50.839568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.090897 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:51.103089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:51.104876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:51.106998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-48484f5e-b107-4753-8d60-c4560519764e tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.292367 Aug 30 04:36:51.109137 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 489/955] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:50 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:51.625056 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:51.625745 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:51.634645 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.635286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.635730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.636589 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.637045 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.637558 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.674753 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:36:51.780838 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2bb9c30a-793f-4ce8-a929-a25e26551290 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 204 len: 0 microversion: 2.1 time: 0.162722 Aug 30 04:36:51.781383 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 467/956] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:36:51 2022] DELETE /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:36:51.791760 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:51.792349 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:51.799301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.799805 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.800274 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.801123 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.801576 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.802030 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.004262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:52.015666 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-a0b7ce59-30ef-41c6-9fa9-4abaef1c9feb tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1502 microversion: 2.1 time: 0.228385 Aug 30 04:36:52.016367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 490/957] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:51 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:52.142462 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:52.143328 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:52.151392 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.152734 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.153343 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.154263 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.154933 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.155475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.349712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:52.359127 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:52.360783 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:52.362104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-475bf743-fadb-4027-b305-4b31e7758449 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.224720 Aug 30 04:36:52.362682 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 468/958] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:52 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:53.048423 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:53.049260 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:53.058033 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.058749 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.059473 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.060510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.060994 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.061451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.251056 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.260577 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e0571ae3-942b-4a12-bb67-fbab7fc6b1aa tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1502 microversion: 2.1 time: 0.217086 Aug 30 04:36:53.261532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 491/959] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:53 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:53.393639 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:53.394832 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:53.407177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.408043 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.408771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.410105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.410678 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.411577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.685178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.695360 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.697216 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.698704 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-32f7209d-01ea-4c5d-a963-841a586d14ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1730 microversion: 2.20 time: 0.310250 Aug 30 04:36:53.699401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 469/960] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:53 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1730 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:36:54.287966 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:54.290168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:54.298585 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.299303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.300295 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.301639 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.302425 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.303406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.419706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1204737db5754fbf995c3c5c6d71e5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e1ae67fada4bd68398e3b997f7d40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:54.427811 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1726bef1-cc46-472f-a4dc-a7a06c2601f7 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 200 len: 1460 microversion: 2.1 time: 0.143901 Aug 30 04:36:54.429807 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 492/961] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:54 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 1460 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:54.528625 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-cf0b6287-08ec-4671-a47d-51e1ca0e27a9 req-8e13ebc0-fa5f-4733-bcce-1d00461311ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5acda76-5108-4ce1-b23f-7f34d5c08e2c", "name": "network-vif-deleted", "tag": "0cdb351e-bba2-4b1b-9d12-5ab44825c77f"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:54.546768 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-cf0b6287-08ec-4671-a47d-51e1ca0e27a9 req-8e13ebc0-fa5f-4733-bcce-1d00461311ea service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.547413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-cf0b6287-08ec-4671-a47d-51e1ca0e27a9 req-8e13ebc0-fa5f-4733-bcce-1d00461311ea service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.548058 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-cf0b6287-08ec-4671-a47d-51e1ca0e27a9 req-8e13ebc0-fa5f-4733-bcce-1d00461311ea service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.564108 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-cf0b6287-08ec-4671-a47d-51e1ca0e27a9 req-8e13ebc0-fa5f-4733-bcce-1d00461311ea service nova] Creating event network-vif-deleted:0cdb351e-bba2-4b1b-9d12-5ab44825c77f for instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c on hv-cinder-85426 Aug 30 04:36:54.573390 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-cf0b6287-08ec-4671-a47d-51e1ca0e27a9 req-8e13ebc0-fa5f-4733-bcce-1d00461311ea service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051237 Aug 30 04:36:54.574009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 470/962] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:54.737884 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:54.738708 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:54.746545 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.747186 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.747976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.748941 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.750025 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.750510 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.992828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:55.008865 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:55.011837 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:55.014136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6151f5f0-0456-4e2a-b837-668516af1e3d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1717 microversion: 2.20 time: 0.282788 Aug 30 04:36:55.015183 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 493/963] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:36:54 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1717 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:36:55.455867 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:55.456622 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] [instance: d5acda76-5108-4ce1-b23f-7f34d5c08e2c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:55.467269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:55.468401 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:55.469085 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:55.470328 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:55.471244 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:55.472185 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:55.497563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] HTTP exception thrown: Instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c could not be found. Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Request method failure captured: Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c HTTP/1.1 Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZPIjXomMT56xjasr-Yas3CUDfzHEQViBedz0wavCcl_h0VDeU14i6Ym82IHq8VEV2kWcNSTZFS0kV4MMG03v9e77E92NAcYa6oWUz-UGy7DMLE_Q1Rp1lFVXsls4xd3M4lfRm8kaueVCdt8OBjYqZGDA05R5BZMyauso3pZQ__MpZQ Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: d2e1ae67fada4bd68398e3b997f7d40e Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-VolumesActionsTest-539257922 Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:36:55.499654 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d2e1ae67fada4bd68398e3b997f7d40e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d2e1ae67fada4bd68398e3b997f7d40e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d2e1ae67fada4bd68398e3b997f7d40e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d2e1ae67fada4bd68398e3b997f7d40e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-VolumesActionsTest-539257922 Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: d2e1ae67fada4bd68398e3b997f7d40e Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-VolumesActionsTest-539257922 Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-VolumesActionsTest-539257922-project Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 1204737db5754fbf995c3c5c6d71e5bb Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-VolumesActionsTest-539257922-project Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c could not be found. Aug 30 04:36:55.502897 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'd5acda76-5108-4ce1-b23f-7f34d5c08e2c'} Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c could not be found. Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:55.508191 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c could not be found. Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c could not be found. Aug 30 04:36:55.510895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:36:55.517414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] Returning 404 to user: Instance d5acda76-5108-4ce1-b23f-7f34d5c08e2c could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:55.517414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d48cd427-33f6-4d2a-abc8-1b73f12831b2 tempest-VolumesActionsTest-539257922 tempest-VolumesActionsTest-539257922-project] 10.222.0.91 "GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c" status: 404 len: 111 microversion: 2.1 time: 0.051583 Aug 30 04:36:55.517414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 471/964] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:55 2022] GET /compute/v2.1/servers/d5acda76-5108-4ce1-b23f-7f34d5c08e2c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:03.555262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:03.556103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:03.559957 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:03.569330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.570001 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.570603 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.571524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.572338 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.572898 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.607954 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-662a3f34-ed82-4abb-8525-cc6e055ec0a4 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/ips" status: 200 len: 149 microversion: 2.1 time: 0.059616 Aug 30 04:37:03.615787 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 494/965] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:37:03 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/ips => generated 149 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:05.056203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9e4de0e-313e-4bf1-afb1-8238c4dc2ba5"}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:05.059212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:05.063261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:05.070759 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.071237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.071672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.072408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.072859 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.073298 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.078121 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:05.415799 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-94bdd12b-384c-432f-b00d-5ee6a5e50def tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "POST /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364924 Aug 30 04:37:05.416463 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 472/966] 10.222.0.91 () {60 vars in 1323 bytes} [Tue Aug 30 04:37:05 2022] POST /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:07.909238 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:07.910075 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:07.929276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:07.930194 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:07.930685 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:07.931417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:07.932175 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:07.932611 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:08.092600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lazy-loading 'services' on Instance uuid dbab3525-5c37-4997-95db-931a3f260aed {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:37:08.201980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c7d65654-82dd-442d-9b83-f07f37682feb tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments/b9e4de0e-313e-4bf1-afb1-8238c4dc2ba5" status: 202 len: 0 microversion: 2.1 time: 0.304031 Aug 30 04:37:08.203522 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 495/967] 10.222.0.91 () {58 vars in 1416 bytes} [Tue Aug 30 04:37:07 2022] DELETE /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments/b9e4de0e-313e-4bf1-afb1-8238c4dc2ba5 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:08.223848 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:08.231706 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:08.250775 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:08.251821 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:08.252730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:08.254104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:08.255009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:08.255568 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:08.321520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-11770f67-2d84-4b68-ad33-c71c7a534db8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111221 Aug 30 04:37:08.322441 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 473/968] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:37:08 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:09.340140 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:09.343076 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:09.351070 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.351486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.351948 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.352681 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.353222 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.353640 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.569430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d4ff4b95-cd46-4648-9305-df0089af7461 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.234613 Aug 30 04:37:09.570204 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 496/969] 10.222.0.91 () {58 vars in 1302 bytes} [Tue Aug 30 04:37:09 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed/os-volume_attachments => generated 25 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:37:09.685268 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:09.686152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:09.697839 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.698664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.699360 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.700588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.701410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.702135 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.749042 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:37:09.850309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-dca7ba46-f3a9-4487-9e96-d71bb16a6fb5 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 204 len: 0 microversion: 2.1 time: 0.171636 Aug 30 04:37:09.851038 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 474/970] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:09 2022] DELETE /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:37:09.861816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:09.862479 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:09.870764 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.871168 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.871600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.872342 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.872834 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.873262 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:10.055077 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:10.063821 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0aa6560e-4333-459a-8e57-be9861eb7ea8 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1681 microversion: 2.1 time: 0.206553 Aug 30 04:37:10.064448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 497/971] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:09 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:11.089489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:11.090477 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:11.098527 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:11.099255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:11.100082 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:11.101048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:11.101607 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:11.102207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:11.265083 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:11.274345 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-22e2fd04-0bd9-465a-8662-49371712ae4a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1681 microversion: 2.1 time: 0.190206 Aug 30 04:37:11.274949 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 475/972] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:11 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:12.298667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.301093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:12.309445 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.310174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.310676 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:12.311757 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.312514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.313042 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:12.708707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:12.724248 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-bfc0acd5-553b-4a8e-bdb2-1bd71baf6319 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1681 microversion: 2.1 time: 0.430182 Aug 30 04:37:12.725322 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 498/973] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1681 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:13.730044 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-495776ae-c4a9-4c57-bb2c-25c80b9d8b3b req-88c59268-94e6-4812-b9a8-c0fbd2efd318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbab3525-5c37-4997-95db-931a3f260aed", "name": "network-vif-deleted", "tag": "65b16c11-23ae-4d39-bd0e-89656267aade"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:13.743413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-495776ae-c4a9-4c57-bb2c-25c80b9d8b3b req-88c59268-94e6-4812-b9a8-c0fbd2efd318 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:13.744450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-495776ae-c4a9-4c57-bb2c-25c80b9d8b3b req-88c59268-94e6-4812-b9a8-c0fbd2efd318 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:13.745114 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-495776ae-c4a9-4c57-bb2c-25c80b9d8b3b req-88c59268-94e6-4812-b9a8-c0fbd2efd318 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:13.759826 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-495776ae-c4a9-4c57-bb2c-25c80b9d8b3b req-88c59268-94e6-4812-b9a8-c0fbd2efd318 service nova] Creating event network-vif-deleted:65b16c11-23ae-4d39-bd0e-89656267aade for instance dbab3525-5c37-4997-95db-931a3f260aed on hv-cinder-85426 Aug 30 04:37:13.765093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:13.767351 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:13.771213 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-495776ae-c4a9-4c57-bb2c-25c80b9d8b3b req-88c59268-94e6-4812-b9a8-c0fbd2efd318 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045577 Aug 30 04:37:13.777149 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 476/974] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:13.787037 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:13.790630 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:13.791184 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:13.792828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:13.794670 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:13.796503 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:13.996566 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adb079fad6c41aca6a619a71a3b7c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:14.007518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-d88a05c3-3fb0-4316-9638-7c2f64f86a6b tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 200 len: 1327 microversion: 2.1 time: 0.251332 Aug 30 04:37:14.012338 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 499/975] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:13 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 1327 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:15.057035 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:15.058428 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:15.072167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:15.073174 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:15.073827 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:15.074879 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:15.075535 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:15.076203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:15.100778 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed HTTP/1.1 Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:15.103520 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:15.105199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'dbab3525-5c37-4997-95db-931a3f260aed'} Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:15.106122 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:15.107405 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:15.110887 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:15.112117 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-78275404-d490-45a5-aeed-3dee68dfdbb7 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 404 len: 111 microversion: 2.1 time: 0.065133 Aug 30 04:37:15.112800 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 477/976] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:15 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:15.125695 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f5509eee-5046-4eba-9e06-86d9ebaf8016 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '.version_select at 0x7f24ec50fa60>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:15.166424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f5509eee-5046-4eba-9e06-86d9ebaf8016 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696485189" status: 202 len: 0 microversion: 2.1 time: 0.047609 Aug 30 04:37:15.167527 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 500/977] 10.222.0.91 () {58 vars in 1221 bytes} [Tue Aug 30 04:37:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696485189 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:17.243981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:17.245765 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:17.254258 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.255021 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.255630 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.256712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.257314 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.257953 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.274177 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: DELETE /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed HTTP/1.1 Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:17.275744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.277806 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'dbab3525-5c37-4997-95db-931a3f260aed'} Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:17.279955 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.283422 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.285588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:17.285588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-17a17131-d085-458b-90da-6ef7d8e8e595 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 404 len: 111 microversion: 2.1 time: 0.038207 Aug 30 04:37:17.285588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 478/978] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:17 2022] DELETE /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:37:17.287290 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:17.287986 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: dbab3525-5c37-4997-95db-931a3f260aed] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:17.295756 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.296276 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.296707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.297421 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.297980 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.298297 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.304286 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:17.314487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed HTTP/1.1 Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:17.316191 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.317923 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'dbab3525-5c37-4997-95db-931a3f260aed'} Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:17.318936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. Aug 30 04:37:17.320448 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:17.321731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance dbab3525-5c37-4997-95db-931a3f260aed could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:17.321731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-6c4a179e-e4da-43b3-8bed-df20e0da673f tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed" status: 404 len: 111 microversion: 2.1 time: 0.035036 Aug 30 04:37:17.321731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 501/979] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:17 2022] GET /compute/v2.1/servers/dbab3525-5c37-4997-95db-931a3f260aed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:18.519034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:18.519744 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:18.527222 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.527716 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.528203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.528918 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.529365 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.529771 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.545628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: DELETE /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c HTTP/1.1 Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:18.547419 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.549203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'ae46ccaf-4960-42d3-b45a-77d43f25430c'} Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:18.550307 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.551537 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.552794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:18.552794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f758e3a2-53f6-4491-80ae-264424cb4dce tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 404 len: 111 microversion: 2.1 time: 0.033964 Aug 30 04:37:18.552794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 479/980] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:18 2022] DELETE /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:18.564060 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:18.565273 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: ae46ccaf-4960-42d3-b45a-77d43f25430c] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:18.575362 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.575873 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.576355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.577096 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.577745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.578174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.594455 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c HTTP/1.1 Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:18.596120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.597626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'ae46ccaf-4960-42d3-b45a-77d43f25430c'} Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:18.598658 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. Aug 30 04:37:18.600581 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.601773 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance ae46ccaf-4960-42d3-b45a-77d43f25430c could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:18.601773 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-cbc1142a-643e-4e07-993c-6a0ed35e675e tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c" status: 404 len: 111 microversion: 2.1 time: 0.042863 Aug 30 04:37:18.601773 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 502/981] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:18 2022] GET /compute/v2.1/servers/ae46ccaf-4960-42d3-b45a-77d43f25430c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:18.608922 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:18.609431 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:18.617469 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.618004 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.618498 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.619409 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.620376 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.621041 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.637178 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: DELETE /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a HTTP/1.1 Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:18.638749 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.640978 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '72a97f79-ee44-4f9c-bd29-4042d2f4bb2a'} Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:18.642823 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.645145 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.650001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:18.650001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-f37e8327-9cde-4d0d-9cd7-71adbd7bed7a tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 404 len: 111 microversion: 2.1 time: 0.035725 Aug 30 04:37:18.650001 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 480/982] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:18 2022] DELETE /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:37:18.651598 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:18.653110 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:18.660905 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.661399 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.661839 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.663248 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.664104 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.664681 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.690627 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a HTTP/1.1 Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:18.692435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.694562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '72a97f79-ee44-4f9c-bd29-4042d2f4bb2a'} Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:18.695704 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. Aug 30 04:37:18.697113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:18.698850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance 72a97f79-ee44-4f9c-bd29-4042d2f4bb2a could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:18.698850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-62a6019c-4210-440e-86db-5af30c05ed45 tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a" status: 404 len: 111 microversion: 2.1 time: 0.047332 Aug 30 04:37:18.698850 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 503/983] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:18 2022] GET /compute/v2.1/servers/72a97f79-ee44-4f9c-bd29-4042d2f4bb2a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:37:19.919090 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:19.920045 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:19.933664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.934579 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.935299 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.936658 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.937474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.938246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.960385 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: DELETE /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 HTTP/1.1 Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:19.962237 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:19.964774 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'fe95c6ff-83ad-4fcd-9d95-59695f830f10'} Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:19.966471 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:19.968584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:19.970115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:19.970115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-daf0be48-ec90-4db0-ad0a-a6b313806a0d tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "DELETE /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 404 len: 111 microversion: 2.1 time: 0.053281 Aug 30 04:37:19.970115 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 481/984] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:19 2022] DELETE /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:19.988209 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:19.989057 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] [instance: fe95c6ff-83ad-4fcd-9d95-59695f830f10] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:19.996250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.996753 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.997206 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.998003 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.998514 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.998951 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:20.018281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] HTTP exception thrown: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Request method failure captured: Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 HTTP/1.1 Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZKJv8g0mAb0sjLY6JpRxhHziiENtrdlQxiUJdqan9kxDDhWM0kEtghY8bQC-LWcPT6p7HPcloARkn6LJUASDNsrr7UrtaO-oyuoowffHIuOo-hI8H0ngc7-25hXdb-vQ9PZbq6mAExvz-zpcugxnpQMeoKLiwTMf7jNdqnE1M_GiT4 Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:20.019963 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ec24ad0a529d4df7a32b62a1558fa7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: ec24ad0a529d4df7a32b62a1558fa7a8 Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567100923 Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 5adb079fad6c41aca6a619a71a3b7c3a Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeNegativeTest-1567100923-project Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:20.022915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': 'fe95c6ff-83ad-4fcd-9d95-59695f830f10'} Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:20.024532 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. Aug 30 04:37:20.027304 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:20.030932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] Returning 404 to user: Instance fe95c6ff-83ad-4fcd-9d95-59695f830f10 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:20.030932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-50e5db03-a3dc-4c5b-8830-6f013ac3f5be tempest-AttachVolumeNegativeTest-1567100923 tempest-AttachVolumeNegativeTest-1567100923-project] 10.222.0.91 "GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10" status: 404 len: 111 microversion: 2.1 time: 0.038177 Aug 30 04:37:20.030932 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 504/985] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:19 2022] GET /compute/v2.1/servers/fe95c6ff-83ad-4fcd-9d95-59695f830f10 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:20.823349 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:20.824220 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:20.836179 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-0fa9b1f4-97ed-47c3-b7a3-d6106de33b09 req-04b8b880-e430-4411-9d56-c448078c9d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0eee000-87fc-45aa-bb83-92fa9f5b5fab", "tag": "543dac3a-e946-4cd1-8a32-b40f01459925"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:20.847522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:20.849261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:20.851048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:20.852974 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:20.854253 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:20.854969 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:20.887219 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-0fa9b1f4-97ed-47c3-b7a3-d6106de33b09 req-04b8b880-e430-4411-9d56-c448078c9d3c service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:20.888599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-0fa9b1f4-97ed-47c3-b7a3-d6106de33b09 req-04b8b880-e430-4411-9d56-c448078c9d3c service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:20.889713 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-0fa9b1f4-97ed-47c3-b7a3-d6106de33b09 req-04b8b880-e430-4411-9d56-c448078c9d3c service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:20.921991 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Going to try to terminate instance {{(pid=120847) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:37:20.936435 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-0fa9b1f4-97ed-47c3-b7a3-d6106de33b09 req-04b8b880-e430-4411-9d56-c448078c9d3c service nova] Creating event network-changed:543dac3a-e946-4cd1-8a32-b40f01459925 for instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab on hv-cinder-85426 Aug 30 04:37:20.954606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-0fa9b1f4-97ed-47c3-b7a3-d6106de33b09 req-04b8b880-e430-4411-9d56-c448078c9d3c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127155 Aug 30 04:37:20.960160 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 505/986] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:21.031463 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ba76ad3f-a693-4386-b3cb-4e5d4e88b08c tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "DELETE /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 204 len: 0 microversion: 2.1 time: 0.214540 Aug 30 04:37:21.035568 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 482/987] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:20 2022] DELETE /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:37:21.054406 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:21.056004 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:21.067358 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:21.068361 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:21.069087 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.070176 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:21.070641 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:21.071240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.300232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:21.309508 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-9bec277f-aae4-4a6a-afb1-803bd0866543 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.271163 Aug 30 04:37:21.324778 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 506/988] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:21 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:22.335049 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:22.336217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:22.354845 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.355499 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.356065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.356910 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.357475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.358014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.698601 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:22.714993 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-46f46b55-9672-4cea-8455-f4e5df8fce33 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1567 microversion: 2.1 time: 0.384397 Aug 30 04:37:22.716051 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 483/989] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:22 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:23.539752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-bc200494-6c97-48a3-9e50-5562485b07f8 req-90248383-0f47-4277-a6a3-f52197770d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eee000-87fc-45aa-bb83-92fa9f5b5fab", "name": "network-vif-deleted", "tag": "543dac3a-e946-4cd1-8a32-b40f01459925"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:23.562355 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-bc200494-6c97-48a3-9e50-5562485b07f8 req-90248383-0f47-4277-a6a3-f52197770d11 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:23.564518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-bc200494-6c97-48a3-9e50-5562485b07f8 req-90248383-0f47-4277-a6a3-f52197770d11 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:23.565918 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-bc200494-6c97-48a3-9e50-5562485b07f8 req-90248383-0f47-4277-a6a3-f52197770d11 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:23.590575 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-bc200494-6c97-48a3-9e50-5562485b07f8 req-90248383-0f47-4277-a6a3-f52197770d11 service nova] Creating event network-vif-deleted:543dac3a-e946-4cd1-8a32-b40f01459925 for instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab on hv-cinder-85426 Aug 30 04:37:23.596325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-bc200494-6c97-48a3-9e50-5562485b07f8 req-90248383-0f47-4277-a6a3-f52197770d11 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065288 Aug 30 04:37:23.597452 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 507/990] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:23.747450 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:23.751034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:23.771245 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:23.786504 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:23.788672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:23.790384 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:23.798880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:23.799696 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:23.996296 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:24.016839 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d60a266a-0b4d-40dd-b123-2294bfaabb4a tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1381 microversion: 2.1 time: 0.277835 Aug 30 04:37:24.018929 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 484/991] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:23 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1381 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:25.045561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:25.046356 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:25.056583 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:25.057082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:25.057570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:25.058281 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:25.058748 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:25.059177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:25.152336 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:25.152823 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:25.153261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:25.153716 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lazy-loading 'fault' on Instance uuid c0eee000-87fc-45aa-bb83-92fa9f5b5fab {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:37:25.217049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563dbe8a50e34840b6d5b2f9ff65e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89458e4a02d40e4abfd8457f31cc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:25.228182 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e9017b31-3d9e-459c-93c9-d4fcf82ffd05 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 200 len: 1386 microversion: 2.1 time: 0.189267 Aug 30 04:37:25.241695 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 508/992] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:25 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 1386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:26.259156 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:26.260410 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] [instance: c0eee000-87fc-45aa-bb83-92fa9f5b5fab] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:26.271437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:26.272396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:26.273082 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:26.274387 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:26.275482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:26.276217 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:26.297944 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] HTTP exception thrown: Instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab could not be found. Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Request method failure captured: Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab HTTP/1.1 Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZKergXF0pn0kT4wwHpGv4WBIqg9WgWjDPQ0gtC6atzfqw_vE5kPLFVuTXxRcaNa9Jvu5Y6ylHk0nGMo7wUsJu-LDJSAHMAquqWvZOkUorPLeJRNnHaSQETiiVy1SRObN7v4J9Ai2L3GDvxUApkB6iUApLsNOD_Y79YVCim74vDMsME Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: a89458e4a02d40e4abfd8457f31cc0a4 Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-TestShelveInstance-110462149 Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:26.300286 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a89458e4a02d40e4abfd8457f31cc0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a89458e4a02d40e4abfd8457f31cc0a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a89458e4a02d40e4abfd8457f31cc0a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a89458e4a02d40e4abfd8457f31cc0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-TestShelveInstance-110462149 Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: a89458e4a02d40e4abfd8457f31cc0a4 Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-TestShelveInstance-110462149 Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-TestShelveInstance-110462149-project Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 563dbe8a50e34840b6d5b2f9ff65e29a Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-TestShelveInstance-110462149-project Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab could not be found. Aug 30 04:37:26.301808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': 'c0eee000-87fc-45aa-bb83-92fa9f5b5fab'} Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab could not be found. Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:26.303234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab could not be found. Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab could not be found. Aug 30 04:37:26.306184 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:26.308065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Returning 404 to user: Instance c0eee000-87fc-45aa-bb83-92fa9f5b5fab could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:26.308065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3363d2a2-75c3-43f1-b253-8f62ef463d2d tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab" status: 404 len: 111 microversion: 2.1 time: 0.052332 Aug 30 04:37:26.308065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 485/993] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:26 2022] GET /compute/v2.1/servers/c0eee000-87fc-45aa-bb83-92fa9f5b5fab => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:26.549731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0240f07c-bd41-4af7-9f74-f3939b994f40 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] Calling method '.version_select at 0x7f24ec3e91f0>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:26.587761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0240f07c-bd41-4af7-9f74-f3939b994f40 tempest-TestShelveInstance-110462149 tempest-TestShelveInstance-110462149-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1141333383" status: 202 len: 0 microversion: 2.1 time: 0.045646 Aug 30 04:37:26.596429 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 509/994] 10.222.0.91 () {58 vars in 1254 bytes} [Tue Aug 30 04:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1141333383 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:28.237363 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:28.243828 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:28.258789 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.260028 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.265751 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.267604 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.268697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.269665 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.346808 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-a4238e8b-7b38-4a7f-85cf-f8d0b0535626 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.118688 Aug 30 04:37:28.348242 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 486/995] 10.222.0.91 () {60 vars in 1343 bytes} [Tue Aug 30 04:37:28 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:28.516667 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:28.517804 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:28.533172 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.533568 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.533994 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.534736 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.535190 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.535616 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.579860 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:37:28.751818 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-f0f987c0-9d9f-43f4-b4a7-65e0250de95d tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 204 len: 0 microversion: 2.20 time: 0.245082 Aug 30 04:37:28.755130 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 510/996] 10.222.0.91 () {60 vars in 1280 bytes} [Tue Aug 30 04:37:28 2022] DELETE /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:37:28.768588 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:28.769994 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:28.782621 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.783858 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.785072 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.786962 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.788071 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.789555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:29.143610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:29.168948 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:29.173050 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:29.177250 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0bab7dff-40cb-4daa-a76c-1a2e92c766e6 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.416560 Aug 30 04:37:29.180994 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 487/997] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:37:28 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:37:30.233284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:30.237081 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:30.257430 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:30.260280 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:30.262795 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.266203 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:30.267129 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:30.268702 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.895061 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:30.912208 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:30.916861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:30.919499 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8227b206-c694-4478-8b12-18e3c13455ea tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1723 microversion: 2.20 time: 0.700663 Aug 30 04:37:30.922267 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 511/998] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:37:30 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1723 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:37:31.962846 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:31.964071 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:31.973066 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.974029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.974840 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:31.975784 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.976396 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.977243 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:32.177876 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:32.182232 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:32.201006 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:32.202730 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:32.204418 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-2d2c6493-471e-40a3-abbd-a612310ca8d3 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1656 microversion: 2.20 time: 0.255443 Aug 30 04:37:32.205738 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 488/999] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:37:31 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1656 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:37:33.240451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-23e2aba8-7c6b-48b0-8012-5550af6c6bd4 req-f62b9e53-5790-4245-a50e-ee27f956d881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ff6f54-9208-47dc-a7d6-8bbd2f361078", "name": "network-vif-deleted", "tag": "8f9dcf42-2c92-4dfb-86be-a86c9029c626"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:33.262075 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:33.265175 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:33.309246 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:33.310323 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:33.312199 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:33.317446 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:33.319524 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:33.321090 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:33.322261 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-23e2aba8-7c6b-48b0-8012-5550af6c6bd4 req-f62b9e53-5790-4245-a50e-ee27f956d881 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:33.322947 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-23e2aba8-7c6b-48b0-8012-5550af6c6bd4 req-f62b9e53-5790-4245-a50e-ee27f956d881 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:33.328301 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-23e2aba8-7c6b-48b0-8012-5550af6c6bd4 req-f62b9e53-5790-4245-a50e-ee27f956d881 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:33.368599 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-23e2aba8-7c6b-48b0-8012-5550af6c6bd4 req-f62b9e53-5790-4245-a50e-ee27f956d881 service nova] Creating event network-vif-deleted:8f9dcf42-2c92-4dfb-86be-a86c9029c626 for instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 on hv-cinder-85426 Aug 30 04:37:33.381018 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-23e2aba8-7c6b-48b0-8012-5550af6c6bd4 req-f62b9e53-5790-4245-a50e-ee27f956d881 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155330 Aug 30 04:37:33.384974 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 512/1000] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:33.450765 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:33.469020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:33.471595 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91067603d9c549278cdc2d97b54cca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf24ec2c8bd74974932690a583961691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:33.474458 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b05e90ee-f53f-4751-991e-a32d4d292781 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 200 len: 1366 microversion: 2.20 time: 0.229102 Aug 30 04:37:33.475892 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 489/1001] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:37:33 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:37:34.500286 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:34.501149 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:34.503709 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:34.518635 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:34.519402 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:34.520067 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:34.521408 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:34.522120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:34.522844 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:34.540639 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] HTTP exception thrown: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Request method failure captured: Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 HTTP/1.1 Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZI0EZ1pZZZdJ3U9njAxwts4vz1IcNWp5ddKw88CdM2GkkVxF14DtAgKnYMyRmcG6gkgR1xwoCTJF1CUeN1RdseRetSBfj3oHC91h-wx5hvugVSHUgsHPVydnPNty5cYZFjoDKrTAuqI0jyvcUVLo04UeTeGoe4bJRbIoq-m6oSX8wM Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:34.542701 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/cf24ec2c8bd74974932690a583961691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_cf24ec2c8bd74974932690a583961691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 91067603d9c549278cdc2d97b54cca88 Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:34.544533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '52ff6f54-9208-47dc-a7d6-8bbd2f361078'} Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:34.545436 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:34.547173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:34.548487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Returning 404 to user: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:34.548487 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-c4f331ba-fa4c-43a3-b1ca-02b6ed820a68 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 404 len: 111 microversion: 2.20 time: 0.048817 Aug 30 04:37:34.554116 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b616e827-7f2f-413b-bb86-a7bdc58b4f75 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '.version_select at 0x7f24ec712ca0>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:34.559082 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 513/1002] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:37:34 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:37:34.580494 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b616e827-7f2f-413b-bb86-a7bdc58b4f75 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321207001" status: 204 len: 0 microversion: 2.20 time: 0.030260 Aug 30 04:37:34.585702 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 490/1003] 10.222.0.91 () {60 vars in 1259 bytes} [Tue Aug 30 04:37:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321207001 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:37:37.463617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:37.465733 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:37.478136 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:37.479325 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:37.480117 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:37.481824 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:37.482893 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:37.484296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:37.512847 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] HTTP exception thrown: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Request method failure captured: Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 HTTP/1.1 Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZI0EZ1pZZZdJ3U9njAxwts4vz1IcNWp5ddKw88CdM2GkkVxF14DtAgKnYMyRmcG6gkgR1xwoCTJF1CUeN1RdseRetSBfj3oHC91h-wx5hvugVSHUgsHPVydnPNty5cYZFjoDKrTAuqI0jyvcUVLo04UeTeGoe4bJRbIoq-m6oSX8wM Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:37.516195 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/cf24ec2c8bd74974932690a583961691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_cf24ec2c8bd74974932690a583961691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 91067603d9c549278cdc2d97b54cca88 Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.519173 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '52ff6f54-9208-47dc-a7d6-8bbd2f361078'} Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:37.521156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.523424 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.537880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Returning 404 to user: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:37.537880 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8c6a6325-e917-481e-8f68-847c887cd774 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 404 len: 111 microversion: 2.20 time: 0.082398 Aug 30 04:37:37.540404 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 514/1004] 10.222.0.91 () {60 vars in 1280 bytes} [Tue Aug 30 04:37:37 2022] DELETE /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:37:37.551792 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:37.552939 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 52ff6f54-9208-47dc-a7d6-8bbd2f361078] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:37.555408 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:37.566938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:37.570110 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:37.571555 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:37.572712 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:37.573440 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:37.574265 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:37.605411 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] HTTP exception thrown: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Request method failure captured: Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 HTTP/1.1 Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI0EZ1pZZZdJ3U9njAxwts4vz1IcNWp5ddKw88CdM2GkkVxF14DtAgKnYMyRmcG6gkgR1xwoCTJF1CUeN1RdseRetSBfj3oHC91h-wx5hvugVSHUgsHPVydnPNty5cYZFjoDKrTAuqI0jyvcUVLo04UeTeGoe4bJRbIoq-m6oSX8wM Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:37.608950 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/cf24ec2c8bd74974932690a583961691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_cf24ec2c8bd74974932690a583961691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 91067603d9c549278cdc2d97b54cca88 Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.612882 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '52ff6f54-9208-47dc-a7d6-8bbd2f361078'} Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:37.614413 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. Aug 30 04:37:37.620880 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:37.623112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Returning 404 to user: Instance 52ff6f54-9208-47dc-a7d6-8bbd2f361078 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:37.623112 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d88e4adc-0b79-4075-b671-bbc0a701a02a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078" status: 404 len: 111 microversion: 2.20 time: 0.073255 Aug 30 04:37:37.623847 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 491/1005] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:37:37 2022] GET /compute/v2.1/servers/52ff6f54-9208-47dc-a7d6-8bbd2f361078 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:37:38.920198 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:38.921800 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:38.931083 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:38.932442 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:38.933544 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:38.934560 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:38.935258 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:38.935959 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:38.970798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] HTTP exception thrown: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Request method failure captured: Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: DELETE /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 HTTP/1.1 Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZI0EZ1pZZZdJ3U9njAxwts4vz1IcNWp5ddKw88CdM2GkkVxF14DtAgKnYMyRmcG6gkgR1xwoCTJF1CUeN1RdseRetSBfj3oHC91h-wx5hvugVSHUgsHPVydnPNty5cYZFjoDKrTAuqI0jyvcUVLo04UeTeGoe4bJRbIoq-m6oSX8wM Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:38.976148 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/cf24ec2c8bd74974932690a583961691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_cf24ec2c8bd74974932690a583961691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 91067603d9c549278cdc2d97b54cca88 Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: > Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:38.977600 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '72691437-a322-4abe-a51d-6883e8aa8717'} Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:38.978470 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:38.979680 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:38.983308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Returning 404 to user: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:38.986120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e3d8ac9a-e27d-4d1b-9711-96c450c01a3a tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 404 len: 111 microversion: 2.20 time: 0.069597 Aug 30 04:37:38.987945 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 515/1006] 10.222.0.91 () {60 vars in 1280 bytes} [Tue Aug 30 04:37:38 2022] DELETE /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:37:39.004255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:39.004255 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] [instance: 72691437-a322-4abe-a51d-6883e8aa8717] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:39.016925 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.019173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.023931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.033628 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.035743 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.036690 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.090801 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] HTTP exception thrown: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Request method failure captured: Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 HTTP/1.1 Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZI0EZ1pZZZdJ3U9njAxwts4vz1IcNWp5ddKw88CdM2GkkVxF14DtAgKnYMyRmcG6gkgR1xwoCTJF1CUeN1RdseRetSBfj3oHC91h-wx5hvugVSHUgsHPVydnPNty5cYZFjoDKrTAuqI0jyvcUVLo04UeTeGoe4bJRbIoq-m6oSX8wM Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:37:39.092437 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/cf24ec2c8bd74974932690a583961691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_cf24ec2c8bd74974932690a583961691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cf24ec2c8bd74974932690a583961691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: cf24ec2c8bd74974932690a583961691 Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-205971656 Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: 91067603d9c549278cdc2d97b54cca88 Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-AttachVolumeShelveTestJSON-205971656-project Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:39.096065 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '72691437-a322-4abe-a51d-6883e8aa8717'} Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:39.097697 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. Aug 30 04:37:39.100326 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:37:39.102475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] Returning 404 to user: Instance 72691437-a322-4abe-a51d-6883e8aa8717 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:39.102475 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d8d3ceb9-a419-4ed1-a2ee-d655e8da4514 tempest-AttachVolumeShelveTestJSON-205971656 tempest-AttachVolumeShelveTestJSON-205971656-project] 10.222.0.91 "GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717" status: 404 len: 111 microversion: 2.20 time: 0.099703 Aug 30 04:37:39.122733 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 492/1007] 10.222.0.91 () {60 vars in 1277 bytes} [Tue Aug 30 04:37:38 2022] GET /compute/v2.1/servers/72691437-a322-4abe-a51d-6883e8aa8717 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:37:47.861500 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-229d76b9-1b90-4acc-b5e8-83493be88bf6 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Action: 'create', calling method: .version_select at 0x7f24ecadbf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-194898980", "metadata": {"Type": "work"}}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:48.357797 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-229d76b9-1b90-4acc-b5e8-83493be88bf6 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.872396 Aug 30 04:37:48.359778 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 516/1008] 10.222.0.91 () {60 vars in 1156 bytes} [Tue Aug 30 04:37:47 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 876 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 04:37:48.385835 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c3cd653a-6ac5-409b-a94a-2640da4875e3 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Calling method '.version_select at 0x7f24ec455160>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:48.491736 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c3cd653a-6ac5-409b-a94a-2640da4875e3 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90" status: 200 len: 352 microversion: 2.1 time: 0.115398 Aug 30 04:37:48.492723 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 493/1009] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:48 2022] GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:49.507157 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=5 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:49.508125 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:49.515122 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-e8316d74-04d4-405f-81b8-906e1e60e62a tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Calling method '.version_select at 0x7f24ec7f0dc0>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:49.582416 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-e8316d74-04d4-405f-81b8-906e1e60e62a tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90" status: 200 len: 353 microversion: 2.1 time: 0.077048 Aug 30 04:37:49.584572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 517/1010] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:49 2022] GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:49.595152 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:49.596543 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=11 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:49.605382 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-9996a649-14f5-4743-9fd0-ed3bcd7580b8 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Calling method '.version_select at 0x7f24ec688550>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:49.683049 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-9996a649-14f5-4743-9fd0-ed3bcd7580b8 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90" status: 200 len: 353 microversion: 2.1 time: 0.088474 Aug 30 04:37:49.684323 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 494/1011] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:49 2022] GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:49.705111 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-4a0d7886-ee8e-4bd9-80da-9f9640c18a66 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Calling method '.version_select at 0x7f24ec4f0550>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:49.838002 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-4a0d7886-ee8e-4bd9-80da-9f9640c18a66 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90" status: 202 len: 0 microversion: 2.1 time: 0.136840 Aug 30 04:37:49.838905 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 518/1012] 10.222.0.91 () {58 vars in 1248 bytes} [Tue Aug 30 04:37:49 2022] DELETE /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:37:49.848670 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-b9bcfaff-e6d5-4fd4-aef3-91b989bce9cb tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Calling method '.version_select at 0x7f24ec3bf310>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:49.941132 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-b9bcfaff-e6d5-4fd4-aef3-91b989bce9cb tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90" status: 200 len: 352 microversion: 2.1 time: 0.097351 Aug 30 04:37:49.941786 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 495/1013] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:49 2022] GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:50.960915 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-18b4c657-b68a-474b-b448-f958db505df2 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Calling method '.version_select at 0x7f24ec3e9f70>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:51.012763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.wsgi [None req-18b4c657-b68a-474b-b448-f958db505df2 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] HTTP exception thrown: Volume 1f4054a1-26b4-4505-b336-6cd3ca295e90 could not be found. Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-18b4c657-b68a-474b-b448-f958db505df2 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Request method failure captured: Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: request: GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90 HTTP/1.1 Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept: application/json Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Accept-Encoding: identity Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Connection: close Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Length: 0 Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Content-Type: application/json Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Host: 10.222.0.91 Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: Openstack-System-Scope: None Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Auth-Token: gAAAAABjDZQbY6KosnqLGpr2-aA8lA7mov7dhsZHcxx23vRn_zJtfMIRGbVtR4hGuWResP-2w8MKAgJgerynD0nfLocaX6UrdBZbTY_YXeua33E0FxvRTC8Tzc-Jmb8T6IxuFuwA_eFr8zpLZO53a3qNyiQi0SDAysITHx9appnZvddvRabxs0c Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Id: None Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Domain-Name: None Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Identity-Status: Confirmed Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Is-Admin-Project: True Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Id: default Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Domain-Name: Default Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Id: 2babe9b811f1463db6f6a2c189e0f77f Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Project-Name: tempest-VolumesGetTestJSON-307223675 Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Role: member,reader Aug 30 04:37:51.015612 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Roles: member,reader Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/2babe9b811f1463db6f6a2c189e0f77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2babe9b811f1463db6f6a2c189e0f77f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_2babe9b811f1463db6f6a2c189e0f77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2babe9b811f1463db6f6a2c189e0f77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant: tempest-VolumesGetTestJSON-307223675 Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Id: 2babe9b811f1463db6f6a2c189e0f77f Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-Tenant-Name: tempest-VolumesGetTestJSON-307223675 Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User: tempest-VolumesGetTestJSON-307223675-project Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Id: default Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Domain-Name: Default Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Id: 9b64276525de4ecda8902713d1a710b6 Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: X-User-Name: tempest-VolumesGetTestJSON-307223675-project Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: method: Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: exception: Volume 1f4054a1-26b4-4505-b336-6cd3ca295e90 could not be found. Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: action_args: {'id': '1f4054a1-26b4-4505-b336-6cd3ca295e90'} Aug 30 04:37:51.018626 dv-cinder-854265-2-smb devstack@n-api.service[120846]: {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f4054a1-26b4-4505-b336-6cd3ca295e90 could not be found. (HTTP 404) (Request-ID: req-5d2730e3-eafb-4456-89e5-769ab15d7b3d) Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:51.021014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:37:51.024637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f4054a1-26b4-4505-b336-6cd3ca295e90 could not be found. Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:37:51.028578 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f4054a1-26b4-4505-b336-6cd3ca295e90 could not be found. Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f4054a1-26b4-4505-b336-6cd3ca295e90 could not be found. Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: ERROR nova.api.openstack.wsgi Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-18b4c657-b68a-474b-b448-f958db505df2 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] Returning 404 to user: Volume 1f4054a1-26b4-4505-b336-6cd3ca295e90 could not be found. {{(pid=120846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-18b4c657-b68a-474b-b448-f958db505df2 tempest-VolumesGetTestJSON-307223675 tempest-VolumesGetTestJSON-307223675-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90" status: 404 len: 109 microversion: 2.1 time: 0.064028 Aug 30 04:37:51.031211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 519/1014] 10.222.0.91 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:50 2022] GET /compute/v2.1/os-volumes/1f4054a1-26b4-4505-b336-6cd3ca295e90 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:37:52.350210 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1137256412", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "networks": [{"uuid": "0e2729ae-1c6d-4abf-8ed0-9545a4829f8d"}]}} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:52.449013 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.network.neutron [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] validate_networks() for [('0e2729ae-1c6d-4abf-8ed0-9545a4829f8d', None, None, None, None, None)] {{(pid=120847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:37:52.976714 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Flavor limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:37:52.977020 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Image limits 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:37:52.977667 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Flavor pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:37:52.978076 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Image pref 0:0:0 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:37:52.978550 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.virt.hardware [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:37:52.990990 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.991648 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.992136 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.993096 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.993714 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.994360 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:53.015584 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Getting quotas for project a1c4b71eb1c4418db40f314db4478b51. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:53.021931 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.quota [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Getting quotas for user ea5b20f6358c471480c78566d44c573d and project a1c4b71eb1c4418db40f314db4478b51. Resources: {'ram', 'cores', 'instances'} {{(pid=120847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:53.043599 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Going to run 1 instances... {{(pid=120847) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:37:53.048590 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:37:53.154415 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-158f0e0b-150a-4bae-8d3e-722788ca6708 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813241 Aug 30 04:37:53.160381 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 496/1015] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:37:53.168555 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-1029e8f3-7c9a-4be7-9baf-9bbc0c6c14e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:53.169367 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-1029e8f3-7c9a-4be7-9baf-9bbc0c6c14e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:53.279341 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-1029e8f3-7c9a-4be7-9baf-9bbc0c6c14e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:53.294014 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-1029e8f3-7c9a-4be7-9baf-9bbc0c6c14e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1214 microversion: 2.1 time: 0.129824 Aug 30 04:37:53.295767 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 520/1016] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:53 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:54.323272 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:54.324087 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:54.335333 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.336099 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.336765 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.337890 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.338871 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.339725 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.436674 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:54.447659 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6fdb4947-4c75-4aa8-9609-f77dc1b26710 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1266 microversion: 2.1 time: 0.131891 Aug 30 04:37:54.448577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 497/1017] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:54 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:55.475887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:55.477497 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:55.488415 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.489534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.490151 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.491369 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.492437 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.493381 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.692830 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:55.706676 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-25a28761-851a-4df6-bb04-7f8ac4001c7d tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1272 microversion: 2.1 time: 0.237093 Aug 30 04:37:55.708728 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 521/1018] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:55 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:56.763188 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:56.766130 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:56.778956 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.779881 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.785105 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:56.787233 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.789034 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.790214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.055361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:57.070599 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d5c04127-171b-455e-875e-788972dad901 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1314 microversion: 2.1 time: 0.318277 Aug 30 04:37:57.072334 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 498/1019] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:56 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:57.181237 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-29402fbe-de6b-4b04-8bcc-7331d5769e8f req-182069d3-742b-40b2-97bb-589cc943b9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966ea0ac-6e1e-486f-a6da-8f164b7a0d43", "tag": "01ac43a7-cd3e-4f68-8007-8bc881092931"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:57.197451 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-29402fbe-de6b-4b04-8bcc-7331d5769e8f req-182069d3-742b-40b2-97bb-589cc943b9bf service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.199250 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-29402fbe-de6b-4b04-8bcc-7331d5769e8f req-182069d3-742b-40b2-97bb-589cc943b9bf service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.200335 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-29402fbe-de6b-4b04-8bcc-7331d5769e8f req-182069d3-742b-40b2-97bb-589cc943b9bf service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.218285 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-29402fbe-de6b-4b04-8bcc-7331d5769e8f req-182069d3-742b-40b2-97bb-589cc943b9bf service nova] Creating event network-changed:01ac43a7-cd3e-4f68-8007-8bc881092931 for instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 on hv-cinder-85426 Aug 30 04:37:57.225534 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-29402fbe-de6b-4b04-8bcc-7331d5769e8f req-182069d3-742b-40b2-97bb-589cc943b9bf service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055669 Aug 30 04:37:57.227542 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 522/1020] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:58.097293 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:58.099488 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:58.111733 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.112267 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.112702 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.113529 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.114000 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.114535 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.353765 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:58.367239 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-ebc3b877-0bc3-4e57-a99c-2c7f875f02de tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1314 microversion: 2.1 time: 0.276618 Aug 30 04:37:58.368482 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 499/1021] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:58 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:59.393849 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:59.397282 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:59.412453 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.413896 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.414798 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.416269 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.417359 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.418500 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.657334 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:59.674378 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-0e51d396-9f24-44c0-b02c-ecc1a78decaa tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1314 microversion: 2.1 time: 0.288158 Aug 30 04:37:59.676227 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 523/1022] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:59 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:00.703932 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:00.704816 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:00.714523 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:00.715214 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:00.715762 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:00.716814 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:00.717385 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:00.717930 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:00.923996 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:00.941763 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e233812e-19ce-4e84-a9e3-8cc5ac223570 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1314 microversion: 2.1 time: 0.242429 Aug 30 04:38:00.942717 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 500/1023] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:00 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:01.977113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:01.980271 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:01.994069 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.995099 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.996103 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.997791 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.998962 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.000020 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.262672 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-1cd622cc-f8b9-4ef1-a701-79555acfaf6b req-5a01f0bb-7821-4f9a-9da3-9e9a7f01ffcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966ea0ac-6e1e-486f-a6da-8f164b7a0d43", "name": "network-vif-plugged", "status": "completed", "tag": "01ac43a7-cd3e-4f68-8007-8bc881092931"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:02.266474 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:02.280593 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-b92de19b-6b3c-4a5b-9fd2-6de1668543a1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1314 microversion: 2.1 time: 0.314476 Aug 30 04:38:02.281767 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-1cd622cc-f8b9-4ef1-a701-79555acfaf6b req-5a01f0bb-7821-4f9a-9da3-9e9a7f01ffcb service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.282914 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-1cd622cc-f8b9-4ef1-a701-79555acfaf6b req-5a01f0bb-7821-4f9a-9da3-9e9a7f01ffcb service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.284009 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-1cd622cc-f8b9-4ef1-a701-79555acfaf6b req-5a01f0bb-7821-4f9a-9da3-9e9a7f01ffcb service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.293158 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 524/1024] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:01 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:02.311280 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-1cd622cc-f8b9-4ef1-a701-79555acfaf6b req-5a01f0bb-7821-4f9a-9da3-9e9a7f01ffcb service nova] Creating event network-vif-plugged:01ac43a7-cd3e-4f68-8007-8bc881092931 for instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 on hv-cinder-85426 Aug 30 04:38:02.324022 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-1cd622cc-f8b9-4ef1-a701-79555acfaf6b req-5a01f0bb-7821-4f9a-9da3-9e9a7f01ffcb service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069023 Aug 30 04:38:02.325451 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 501/1025] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:03.307143 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:03.307839 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:03.310712 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:03.317366 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.317821 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.318293 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.318998 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.319469 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.319886 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.542653 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:03.554134 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-8649d147-297c-4074-8402-0d9a199846d8 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1314 microversion: 2.1 time: 0.250805 Aug 30 04:38:03.560518 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 525/1026] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:03 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:04.573104 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:04.574369 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=6 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:04.580834 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:04.581758 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:04.590353 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.591207 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.591366 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.592003 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.592605 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.593029 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.767171 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:04.780238 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-0abad7fe-b239-45b7-a7c3-5da25f500207 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1499 microversion: 2.1 time: 0.207933 Aug 30 04:38:04.781048 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 502/1027] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:04 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1499 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:05.406073 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:05.407366 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:05.417266 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.417815 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.418340 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.419294 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.419761 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.420570 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.450605 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:05.561524 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-78a69c19-de5a-4cb2-a78f-9c5bd08a7416 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "DELETE /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 204 len: 0 microversion: 2.1 time: 0.159854 Aug 30 04:38:05.562637 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 526/1028] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:05 2022] DELETE /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:05.575765 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:05.577770 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:05.586356 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.587157 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.587593 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.588388 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.588845 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.589269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.757128 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:05.767587 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-3dfa8dba-998a-42eb-85f5-5f993804d700 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1505 microversion: 2.1 time: 0.198980 Aug 30 04:38:05.768678 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 503/1029] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:05 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:06.800946 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:06.802102 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:06.814784 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.815814 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.816762 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.817936 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.818975 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.819792 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.223160 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:07.233916 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-97cbc0da-7741-4e88-92c4-bab83302ba4b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1505 microversion: 2.1 time: 0.446988 Aug 30 04:38:07.250156 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 527/1030] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:06 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:07.862643 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-7f08c491-afd1-41d3-ac41-6c7b4d4fd8cb req-548985ac-10f4-4e02-a1b9-f5bb82d9d0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966ea0ac-6e1e-486f-a6da-8f164b7a0d43", "name": "network-vif-deleted", "tag": "01ac43a7-cd3e-4f68-8007-8bc881092931"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:07.886726 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7f08c491-afd1-41d3-ac41-6c7b4d4fd8cb req-548985ac-10f4-4e02-a1b9-f5bb82d9d0d4 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.892487 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7f08c491-afd1-41d3-ac41-6c7b4d4fd8cb req-548985ac-10f4-4e02-a1b9-f5bb82d9d0d4 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.893432 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-7f08c491-afd1-41d3-ac41-6c7b4d4fd8cb req-548985ac-10f4-4e02-a1b9-f5bb82d9d0d4 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.910827 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-7f08c491-afd1-41d3-ac41-6c7b4d4fd8cb req-548985ac-10f4-4e02-a1b9-f5bb82d9d0d4 service nova] Creating event network-vif-deleted:01ac43a7-cd3e-4f68-8007-8bc881092931 for instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 on hv-cinder-85426 Aug 30 04:38:07.928631 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-7f08c491-afd1-41d3-ac41-6c7b4d4fd8cb req-548985ac-10f4-4e02-a1b9-f5bb82d9d0d4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073612 Aug 30 04:38:07.929269 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 504/1031] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:08.261650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:08.262546 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:08.272741 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.273925 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.274606 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.275763 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.276776 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.277552 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.322876 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.323668 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.324296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.324910 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lazy-loading 'fault' on Instance uuid 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:38:08.405417 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:08.420572 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-69f3b433-f99c-4bb0-bbfd-6ac1d947c742 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 200 len: 1304 microversion: 2.1 time: 0.165975 Aug 30 04:38:08.421178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 528/1032] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:08 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:09.446180 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:09.447660 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 966ea0ac-6e1e-486f-a6da-8f164b7a0d43] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:09.460173 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.461109 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.462026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.463469 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.464664 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.465399 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.493962 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] HTTP exception thrown: Instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 could not be found. Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Request method failure captured: Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 HTTP/1.1 Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZQeQ94L67TNiQy6rqEWtBUXxLvjk7lMKzoB1S7a0xdwEB7ReBx5Gh2eVMVX5IG__2zUUm2ijTCbURfPQJeUpqEjM4B4CI5wuCKLKcZTc3TKrL9yJgiYZtx0SbCyqexaPqCjLhI4KdMGXkw0YN2f6CALtDqQel_PXQwmwu2845UkL4k Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: a1c4b71eb1c4418db40f314db4478b51 Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-VolumesActionsTest-1053792423 Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:38:09.497507 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-VolumesActionsTest-1053792423 Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: a1c4b71eb1c4418db40f314db4478b51 Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-VolumesActionsTest-1053792423 Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-VolumesActionsTest-1053792423-project Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: ea5b20f6358c471480c78566d44c573d Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-VolumesActionsTest-1053792423-project Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 could not be found. Aug 30 04:38:09.499203 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '966ea0ac-6e1e-486f-a6da-8f164b7a0d43'} Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 could not be found. Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:09.501018 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 could not be found. Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 could not be found. Aug 30 04:38:09.502563 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.504736 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Returning 404 to user: Instance 966ea0ac-6e1e-486f-a6da-8f164b7a0d43 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:09.504736 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d351b6b6-94c0-4074-b91e-85569dd987cc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43" status: 404 len: 111 microversion: 2.1 time: 0.063727 Aug 30 04:38:09.507837 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 505/1033] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:09 2022] GET /compute/v2.1/servers/966ea0ac-6e1e-486f-a6da-8f164b7a0d43 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:09.701069 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-840389800", "imageRef": "94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee", "flavorRef": "452", "networks": [{"uuid": "0e2729ae-1c6d-4abf-8ed0-9545a4829f8d"}]}} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:09.812650 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.network.neutron [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] validate_networks() for [('0e2729ae-1c6d-4abf-8ed0-9545a4829f8d', None, None, None, None, None)] {{(pid=120846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:38:10.707162 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Flavor limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:38:10.708155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Image limits 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:38:10.709089 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Flavor pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:38:10.710463 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Image pref 0:0:0 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:38:10.712968 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.virt.hardware [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:38:10.727822 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.729034 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.729710 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.730707 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.731181 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.731601 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.758562 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Getting quotas for project a1c4b71eb1c4418db40f314db4478b51. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:10.764596 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.quota [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Getting quotas for user ea5b20f6358c471480c78566d44c573d and project a1c4b71eb1c4418db40f314db4478b51. Resources: {'ram', 'cores', 'instances'} {{(pid=120846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:10.794155 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Going to run 1 instances... {{(pid=120846) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:38:10.799093 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94eefc41-fbfb-4ba9-a64e-d1f6bba3dcee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:38:10.877017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-817d0a04-3a16-4b5e-ab06-5930a15ba266 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183538 Aug 30 04:38:10.878617 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 529/1034] 10.222.0.91 () {60 vars in 1147 bytes} [Tue Aug 30 04:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:38:10.893338 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-34ca62d4-e94c-46a3-9f82-1b98cc94d1b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:10.893981 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-34ca62d4-e94c-46a3-9f82-1b98cc94d1b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:10.967309 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-34ca62d4-e94c-46a3-9f82-1b98cc94d1b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:10.981592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-34ca62d4-e94c-46a3-9f82-1b98cc94d1b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1213 microversion: 2.1 time: 0.095519 Aug 30 04:38:10.982489 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 506/1035] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:10 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:12.009750 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:12.011887 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:12.025409 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.027024 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.027785 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.029407 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.030211 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.031218 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.139113 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:12.152858 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-53b56876-0e82-4f8e-b723-46338816ee59 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1265 microversion: 2.1 time: 0.151544 Aug 30 04:38:12.154011 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 530/1036] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:11 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:13.180212 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.181225 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.191587 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.192148 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.192578 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.193741 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.194355 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.194767 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.268062 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:13.279954 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-6ede5757-ab93-48e1-a2b2-362350f3c8e1 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1271 microversion: 2.1 time: 0.104388 Aug 30 04:38:13.281100 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 507/1037] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:13 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:14.304234 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:14.305012 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:14.313017 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.314349 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.315114 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.316166 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.317330 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.317687 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.380814 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-14db5db5-e614-45b8-a876-1a019d9d85cd req-9a382690-6695-4d34-93a5-ae147deac00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba6535d-5055-428d-bcd8-3e7075f18c41", "tag": "48b37520-f2c9-4d23-a359-43c5f67c7cf5"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:14.420005 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-14db5db5-e614-45b8-a876-1a019d9d85cd req-9a382690-6695-4d34-93a5-ae147deac00b service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.421285 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-14db5db5-e614-45b8-a876-1a019d9d85cd req-9a382690-6695-4d34-93a5-ae147deac00b service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.421988 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-14db5db5-e614-45b8-a876-1a019d9d85cd req-9a382690-6695-4d34-93a5-ae147deac00b service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.445852 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-14db5db5-e614-45b8-a876-1a019d9d85cd req-9a382690-6695-4d34-93a5-ae147deac00b service nova] Creating event network-changed:48b37520-f2c9-4d23-a359-43c5f67c7cf5 for instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 on hv-cinder-85426 Aug 30 04:38:14.451264 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-14db5db5-e614-45b8-a876-1a019d9d85cd req-9a382690-6695-4d34-93a5-ae147deac00b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077521 Aug 30 04:38:14.451938 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 508/1038] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:14.702976 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:14.718337 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-19a4fddc-fba0-42ff-9944-1f92a296dc15 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1313 microversion: 2.1 time: 0.419433 Aug 30 04:38:14.719303 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 531/1039] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:14 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:15.743577 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:15.744788 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:15.752026 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.753006 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.754532 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.755331 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.755998 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.756964 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.971997 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:15.984491 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-e7945888-deff-4444-a6c2-76c63353ed7f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1313 microversion: 2.1 time: 0.247528 Aug 30 04:38:15.986817 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 509/1040] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:15 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:17.027006 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.027816 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.035389 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.036051 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.036488 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.037561 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.038013 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.038434 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.214009 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:17.223122 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-ea46fbb5-f1b5-4a96-9b77-7d173d081925 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1313 microversion: 2.1 time: 0.199964 Aug 30 04:38:17.223731 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 532/1041] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:18.252540 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:18.255240 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:18.269373 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.270232 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.271427 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.272261 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.272867 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.273515 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.284746 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [req-84ca8cc2-41c4-4998-90ae-73a5fe8f1af1 req-4e25f6ee-1ff5-45e3-8e75-06df4df7c5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba6535d-5055-428d-bcd8-3e7075f18c41", "name": "network-vif-plugged", "status": "completed", "tag": "48b37520-f2c9-4d23-a359-43c5f67c7cf5"}]} {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:18.306895 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-84ca8cc2-41c4-4998-90ae-73a5fe8f1af1 req-4e25f6ee-1ff5-45e3-8e75-06df4df7c5c5 service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.308232 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-84ca8cc2-41c4-4998-90ae-73a5fe8f1af1 req-4e25f6ee-1ff5-45e3-8e75-06df4df7c5c5 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.309257 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [req-84ca8cc2-41c4-4998-90ae-73a5fe8f1af1 req-4e25f6ee-1ff5-45e3-8e75-06df4df7c5c5 service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.331177 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.compute.server_external_events [req-84ca8cc2-41c4-4998-90ae-73a5fe8f1af1 req-4e25f6ee-1ff5-45e3-8e75-06df4df7c5c5 service nova] Creating event network-vif-plugged:48b37520-f2c9-4d23-a359-43c5f67c7cf5 for instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 on hv-cinder-85426 Aug 30 04:38:18.346240 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [req-84ca8cc2-41c4-4998-90ae-73a5fe8f1af1 req-4e25f6ee-1ff5-45e3-8e75-06df4df7c5c5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068722 Aug 30 04:38:18.346861 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 533/1042] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:18.503557 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:18.515253 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-c87b3c28-2421-409b-ad63-790c010d4eb3 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1313 microversion: 2.1 time: 0.273204 Aug 30 04:38:18.516252 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 510/1043] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:18 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:19.542031 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:19.542975 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:19.545533 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:19.554459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.555146 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.556048 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.556942 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.557692 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.558296 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.567745 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:19.799174 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:19.808958 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-eeb5d204-a9aa-4a03-9514-3a8a2220af1e tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1313 microversion: 2.1 time: 0.272908 Aug 30 04:38:19.809563 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 534/1044] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:19 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:20.835794 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:20.837813 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:20.845661 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:20.848606 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.849687 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.850558 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.851888 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.852474 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.852962 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.858455 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell1:SELECT=65 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:20.983360 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG dbcounter [-] [120847] Writing DB stats nova_cell0:SELECT=2 {{(pid=120847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:21.089137 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:21.100234 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-d7bd4c3a-05a5-410a-a5e8-c448bb2f532b tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1497 microversion: 2.1 time: 0.270364 Aug 30 04:38:21.101231 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 511/1045] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:20 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1497 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:21.810495 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.811133 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.814817 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=2 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:21.815780 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG dbcounter [-] [120846] Writing DB stats nova_cell0:SELECT=6 {{(pid=120846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:21.828007 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.828999 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.830298 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.832811 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.833828 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.834686 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.892964 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Going to try to terminate instance {{(pid=120846) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:22.049433 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-3ceaa764-7eaf-400e-8a8d-20103e4916ed tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "DELETE /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 204 len: 0 microversion: 2.1 time: 0.243423 Aug 30 04:38:22.051729 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 535/1046] 10.222.0.91 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:21 2022] DELETE /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:22.061027 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:22.062528 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:22.071270 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.072014 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.072761 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.073733 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.074722 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.075496 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.303895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.policy [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120847) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:22.313895 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-70603993-a78c-4fe2-832c-502300d864dc tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1503 microversion: 2.1 time: 0.257033 Aug 30 04:38:22.314689 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 512/1047] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:22 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:23.354639 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:23.356178 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:23.373623 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.374120 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.374752 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.375892 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.376620 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.377051 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.662661 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:23.678045 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-089a8c75-94e8-42e6-abd2-0a7fa71256b5 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1503 microversion: 2.1 time: 0.331187 Aug 30 04:38:23.679321 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 536/1048] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:23 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:24.517971 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [req-86c55486-8780-4e61-a380-317175207e50 req-945931c5-9f56-4656-9c4c-1833bab091bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba6535d-5055-428d-bcd8-3e7075f18c41", "name": "network-vif-deleted", "tag": "48b37520-f2c9-4d23-a359-43c5f67c7cf5"}]} {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:24.534989 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-86c55486-8780-4e61-a380-317175207e50 req-945931c5-9f56-4656-9c4c-1833bab091bc service nova] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:24.535819 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-86c55486-8780-4e61-a380-317175207e50 req-945931c5-9f56-4656-9c4c-1833bab091bc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:24.536857 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [req-86c55486-8780-4e61-a380-317175207e50 req-945931c5-9f56-4656-9c4c-1833bab091bc service nova] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.559091 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.compute.server_external_events [req-86c55486-8780-4e61-a380-317175207e50 req-945931c5-9f56-4656-9c4c-1833bab091bc service nova] Creating event network-vif-deleted:48b37520-f2c9-4d23-a359-43c5f67c7cf5 for instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 on hv-cinder-85426 Aug 30 04:38:24.568167 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [req-86c55486-8780-4e61-a380-317175207e50 req-945931c5-9f56-4656-9c4c-1833bab091bc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055914 Aug 30 04:38:24.569581 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 513/1049] 10.222.0.91 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:24.725446 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.api.openstack.wsgi [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:24.728049 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.compute.api [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120846) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:24.743445 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:24.744801 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:24.745411 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.746706 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:24.748054 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:24.749065 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.817966 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:24.819486 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:24.820550 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG oslo_concurrency.lockutils [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.821308 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.objects.instance [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lazy-loading 'fault' on Instance uuid 8ba6535d-5055-428d-bcd8-3e7075f18c41 {{(pid=120846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:38:24.896284 dv-cinder-854265-2-smb devstack@n-api.service[120846]: DEBUG nova.policy [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5b20f6358c471480c78566d44c573d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4b71eb1c4418db40f314db4478b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120846) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:24.915459 dv-cinder-854265-2-smb devstack@n-api.service[120846]: INFO nova.api.openstack.requestlog [None req-886b5226-86ff-4742-8342-e7f65fd08492 tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 200 len: 1303 microversion: 2.1 time: 0.199404 Aug 30 04:38:24.917329 dv-cinder-854265-2-smb devstack@n-api.service[120846]: [pid: 120846|app: 0|req: 537/1050] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:24 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:25.941038 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Calling method '>' {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:25.941914 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.compute.api [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] [instance: 8ba6535d-5055-428d-bcd8-3e7075f18c41] Fetching instance by UUID {{(pid=120847) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:25.951522 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.952414 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.953149 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.954845 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Acquiring lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.955610 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.957211 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG oslo_concurrency.lockutils [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Lock "f61739b9-662a-4f7a-9573-4e7676b7b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.983358 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.wsgi [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] HTTP exception thrown: Instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 could not be found. Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Request method failure captured: Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: request: GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 HTTP/1.1 Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept: application/json Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Accept-Encoding: identity Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Connection: close Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Length: 0 Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Content-Type: application/json Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Host: 10.222.0.91 Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: Openstack-System-Scope: None Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Auth-Token: gAAAAABjDZQeQ94L67TNiQy6rqEWtBUXxLvjk7lMKzoB1S7a0xdwEB7ReBx5Gh2eVMVX5IG__2zUUm2ijTCbURfPQJeUpqEjM4B4CI5wuCKLKcZTc3TKrL9yJgiYZtx0SbCyqexaPqCjLhI4KdMGXkw0YN2f6CALtDqQel_PXQwmwu2845UkL4k Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Id: None Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Domain-Name: None Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Identity-Status: Confirmed Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Is-Admin-Project: True Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Id: default Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Domain-Name: Default Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Id: a1c4b71eb1c4418db40f314db4478b51 Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Project-Name: tempest-VolumesActionsTest-1053792423 Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Role: member,reader Aug 30 04:38:25.986937 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Roles: member,reader Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a1c4b71eb1c4418db40f314db4478b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant: tempest-VolumesActionsTest-1053792423 Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Id: a1c4b71eb1c4418db40f314db4478b51 Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-Tenant-Name: tempest-VolumesActionsTest-1053792423 Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User: tempest-VolumesActionsTest-1053792423-project Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Id: default Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Domain-Name: Default Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Id: ea5b20f6358c471480c78566d44c573d Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: X-User-Name: tempest-VolumesActionsTest-1053792423-project Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: method: > Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: exception: Instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 could not be found. Aug 30 04:38:25.989904 dv-cinder-854265-2-smb devstack@n-api.service[120847]: action_args: {'id': '8ba6535d-5055-428d-bcd8-3e7075f18c41'} Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: {{(pid=120847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 could not be found. Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:25.991361 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 could not be found. Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 could not be found. Aug 30 04:38:25.993592 dv-cinder-854265-2-smb devstack@n-api.service[120847]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.996766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: DEBUG nova.api.openstack.wsgi [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] Returning 404 to user: Instance 8ba6535d-5055-428d-bcd8-3e7075f18c41 could not be found. {{(pid=120847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:25.996766 dv-cinder-854265-2-smb devstack@n-api.service[120847]: INFO nova.api.openstack.requestlog [None req-5563590f-d65b-482a-9caf-49324618089f tempest-VolumesActionsTest-1053792423 tempest-VolumesActionsTest-1053792423-project] 10.222.0.91 "GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41" status: 404 len: 111 microversion: 2.1 time: 0.055317 Aug 30 04:38:25.997457 dv-cinder-854265-2-smb devstack@n-api.service[120847]: [pid: 120847|app: 0|req: 514/1051] 10.222.0.91 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:25 2022] GET /compute/v2.1/servers/8ba6535d-5055-428d-bcd8-3e7075f18c41 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)